Aug 26 02:59:36 devstack cinder-volume[83152]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 26 02:59:36 devstack cinder-volume[83152]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 02:59:36 devstack cinder-volume[83152]: we strongly recommend against using it for new projects.
Aug 26 02:59:36 devstack cinder-volume[83152]: If you are already using Eventlet, we recommend migrating to a different
Aug 26 02:59:36 devstack cinder-volume[83152]: framework.  For more detail see
Aug 26 02:59:36 devstack cinder-volume[83152]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 02:59:36 devstack cinder-volume[83152]:   import eventlet  # noqa
Aug 26 02:59:39 devstack cinder-volume[83152]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 02:59:39 devstack cinder-volume[83152]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 02:59:39 devstack cinder-volume[83152]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 02:59:40 devstack cinder-volume[83152]: INFO dbcounter [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Registered counter for database cinder
Aug 26 02:59:40 devstack cinder-volume[83152]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 02:59:40 devstack cinder-volume[83152]: DEBUG dbcounter [-] [83152] Writer thread running {{(pid=83152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 02:59:40 devstack cinder-volume[83152]: INFO cinder.rpc [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 26 02:59:40 devstack cinder-volume[83152]: INFO cinder.rpc [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 26 02:59:40 devstack cinder-volume[83152]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 02:59:40 devstack cinder-volume[83152]: INFO cinder.volume.manager [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Determined volume DB was empty at startup.
Aug 26 02:59:40 devstack cinder-volume[83152]: DEBUG cinder.volume.manager [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83152) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 26 02:59:40 devstack cinder-volume[83152]: INFO cinder.volume.manager [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 26 02:59:40 devstack cinder-volume[83152]: WARNING stevedore.named [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 02:59:40 devstack cinder-volume[83152]: WARNING castellan.key_manager [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 02:59:40 devstack cinder-volume[83152]: WARNING cinder.keymgr.conf_key_mgr [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 02:59:40 devstack cinder-volume[83152]: DEBUG cinder.volume.drivers.lvm [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83152) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Aug 26 02:59:40 devstack cinder-volume[83152]: DEBUG oslo_concurrency.processutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_concurrency.processutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] CMD "cinder-rtstool verify" returned: 0 in 0.629s {{(pid=83152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 02:59:41 devstack cinder-volume[83152]: INFO cinder.rpc [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 26 02:59:41 devstack cinder-volume[83152]: INFO cinder.rpc [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Aug 26 02:59:41 devstack cinder-volume[83152]: WARNING stevedore.named [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 02:59:41 devstack cinder-volume[83152]: WARNING castellan.key_manager [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 02:59:41 devstack cinder-volume[83152]: INFO cinder.volume.manager [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 02:59:41 devstack cinder-volume[83152]: INFO oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Starting 1 workers
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Started child 83428 {{(pid=83152) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Full set of CONF: {{(pid=83152) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] ******************************************************************************** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Configuration options gathered from: {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] ================================================================================ {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] allow_availability_zone_fallback = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] allow_compression_on_image_upload = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] allowed_direct_url_schemes     = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] api_rate_limit                 = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] auth_strategy                  = keystone {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] az_cache_duration              = 3600 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_availability_zone      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_host                   = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_name                   = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_stats_polling_interval = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backup_api_class               = cinder.backup.api.API {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backup_name_template           = backup-%s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backup_use_same_host           = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backup_use_temp_snapshot       = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] chap_password                  = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] chap_username                  =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_internal_tenant_project_id = 40d7c7d92d994b478599ce4ce8b50493 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_internal_tenant_user_id = 9a1a069e828e4a819a880dd1d37f2cf2 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cloned_volume_same_az          = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cluster                        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] compression_format             = gzip {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] compute_api_class              = cinder.compute.nova.API {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] config_dir                     = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] config_source                  = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] control_exchange               = openstack {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] debug                          = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] default_availability_zone      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] default_group_type             = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] default_volume_type            = lvmdriver-1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] disk_geometry                  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] driver_client_cert             = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] driver_client_cert_key         = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] driver_data_namespace          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] driver_ssl_cert_path           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] driver_ssl_cert_verify         = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] driver_use_ssl                 = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] enable_force_upload            = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] enable_new_services            = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] enable_unsupported_driver      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] enforce_multipath_for_image_xfer = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] filter_function                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_api_insecure            = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_api_ssl_compression     = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_ca_certificates_file    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_catalog_info            = image:glance:publicURL {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83428]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_certfile                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_keyfile                 = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_num_retries             = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance_request_timeout         = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] goodness_function              = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] graceful_shutdown_timeout      = 5 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] group_api_class                = cinder.group.api.API {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] host                           = devstack {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_compress_on_upload       = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_conversion_address_space_limit = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_conversion_cpu_limit     = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_conversion_disable       = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_upload_use_cinder_backend = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_upload_use_internal_tenant = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_volume_cache_enabled     = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_volume_cache_max_count   = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] image_volume_cache_max_size_gb = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] init_host_max_objects_retrieval = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] instance_format                = [instance: %(uuid)s]  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] iscsi_target_flags             =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] iscsi_write_cache              = on {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] iser_helper                    = tgtadm {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] iser_ip_address                = 192.168.122.19 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] iser_port                      = 3260 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_color                      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_config_append              = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_dir                        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_file                       = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_options                    = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_rotate_interval            = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_rotate_interval_type       = days {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] log_rotation_type              = none {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] max_age                        = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] max_logfile_count              = 30 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] max_logfile_size_mb            = 200 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] max_over_subscription_ratio    = 20.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] message_reap_interval          = 86400 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] message_ttl                    = 2592000 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] migration_create_volume_timeout_secs = 300 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] monkey_patch                   = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] monkey_patch_modules           = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] my_ip                          = 192.168.122.19 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] no_snapshot_gb_quota           = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] num_iser_scan_tries            = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] num_shell_tries                = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] num_volume_device_scan_tries   = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] nvmeof_conn_info_version       = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] nvmet_ns_id                    = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] nvmet_port_id                  = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_max_limit                = 1000 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_volume_ext_list          = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_volume_listen_port       = 8776 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_volume_use_ssl           = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] osapi_volume_workers           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] per_volume_size_limit          = -1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] periodic_fuzzy_delay           = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] periodic_interval              = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] public_endpoint                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] publish_errors                 = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_backup_gigabytes         = 1000 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_backups                  = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_gigabytes                = 1000 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_groups                   = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_snapshots                = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] quota_volumes                  = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] rate_limit_burst               = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] rate_limit_except_level        = CRITICAL {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] rate_limit_interval            = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] reinit_driver_count            = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] replication_device             = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] report_discard_supported       = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] report_interval                = 120 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] reservation_clean_interval     = 86400 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] reservation_expire             = 86400 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] reserved_image_namespaces      = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] reserved_percentage            = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] rpc_response_timeout           = 120 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] run_external_periodic_tasks    = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] scst_target_driver             = iscsi {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] scst_target_iqn_name           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_down_time              = 720 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] shell_completion               = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] snapshot_name_template         = snapshot-%s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] snapshot_same_host             = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] split_loggers                  = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] state_path                     = /opt/stack/data/cinder {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] storage_availability_zone      = nova {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] storage_protocol               = iSCSI {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] syslog_log_facility            = LOG_USER {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] target_helper                  = lioadm {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] target_ip_address              = 192.168.122.19 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] target_port                    = 3260 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] target_protocol                = iscsi {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] target_secondary_ip_addresses  = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] trace_flags                    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] transport_url                  = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] until_refresh                  = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_chap_auth                  = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_default_quota_class        = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_journal                    = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_json                       = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_multipath_for_image_xfer   = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_stderr                     = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] use_syslog                     = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] verify_glance_signatures       = enabled {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_api_class               = cinder.volume.api.API {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_backend_name            = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_clear                   = zero {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_clear_ionice            = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_clear_size              = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_copy_bps_limit          = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_dd_blocksize            = 1M {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_name_template           = volume-%s {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_service_inithost_offload = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volume_usage_audit_period      = month {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] zoning_mode                    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_concurrency.disable_process_locking = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.auth_section = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.auth_type   = password {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.auth_version = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.cache       = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.certfile    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.delay_auth_decision = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.http_connect_timeout = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.include_service_catalog = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.insecure    = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.interface   = public {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.keyfile     = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_password = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcache_username = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.region_name = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.service_token_roles_required = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.service_type = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.token_cache_time = 300 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.backend                  = dogpile.cache.null {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.backend_argument         = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.backend_expiration_time  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.config_prefix            = cache.oslo {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.debug_cache_backend      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.enable_retry_client      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.enable_socket_keepalive  = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.enabled                  = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.expiration_time          = 600 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.hashclient_retry_attempts = 2 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_dead_retry      = 300 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_pool_maxsize    = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_sasl_enabled    = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.password                 = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.proxies                  = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.redis_db                 = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.redis_sentinel_service_name = mymaster {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.redis_server             = localhost:6379 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.retry_attempts           = 2 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.retry_delay              = 0.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.socket_keepalive_count   = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.socket_keepalive_idle    = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.socket_keepalive_interval = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.socket_timeout           = 1.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.tls_allowed_ciphers      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.tls_cafile               = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.tls_certfile             = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.tls_enabled              = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.tls_keyfile              = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cache.username                 = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] coordination.backend_url       = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.asyncio_connection    = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.asyncio_slave_connection = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.backend               = sqlalchemy {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.connection            = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:41 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.connection_debug      = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.connection_parameters =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.connection_recycle_time = 3600 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.connection_trace      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.db_inc_retry_interval = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.db_max_retries        = 20 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.db_max_retry_interval = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.db_retry_interval     = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.max_overflow          = 50 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.max_pool_size         = 5 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.max_retries           = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.mysql_wsrep_sync_wait = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.pool_timeout          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.retry_interval        = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.slave_connection      = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.sqlite_synchronous    = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.synchronous_reader    = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] database.use_db_reconnect      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: INFO cinder.volume.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.connection_string     = messaging:// {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.enabled               = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.es_doc_type           = notification {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.es_scroll_size        = 10000 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.es_scroll_time        = 2m {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.filter_error_trace    = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.hmac_keys             = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.sentinel_service_name = mymaster {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.socket_timeout        = 0.1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.trace_requests        = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler.trace_sqlalchemy      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler_jaeger.process_tags   = {} {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler_jaeger.service_name_prefix = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] profiler_otlp.service_name_prefix = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.enforce_new_defaults = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.policy_default_rule = default {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.policy_file        = policy.yaml {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.group          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.helper_command = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] privsep_osbrick.user           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.group         = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.helper_command = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] cinder_sys_admin.user          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.auth_section      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.auth_type         = password {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.cafile            = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.certfile          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.collect_timing    = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.insecure          = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.keyfile           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.send_service_user_token = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.split_loggers     = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] service_user.timeout           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.auth_section            = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.auth_type               = password {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.certfile                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.collect_timing          = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.insecure                = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.keyfile                 = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.region_name             = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.split_loggers           = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] glance.timeout                 = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.backend_availability_zone = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.chap_password = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.chap_username =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.disk_geometry = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.driver_client_cert = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.driver_client_cert_key = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.driver_data_namespace = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.driver_use_ssl = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.enable_unsupported_driver = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.extra_capabilities = {} {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.filter_function = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.goodness_function = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.iscsi_target_flags =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.iscsi_write_cache = on {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.iser_helper   = tgtadm {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.iser_port     = 3260 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.lvm_share_target = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.lvm_type      = auto {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.num_shell_tries = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.nvmet_port_id = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.replication_device = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.report_discard_supported = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.reserved_percentage = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.scst_target_driver = iscsi {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.scst_target_iqn_name = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.storage_protocol = iSCSI {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.target_helper = tgtadm {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.target_port   = 3260 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.target_protocol = iscsi {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.trace_flags   = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.unique_fqdn_network = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.use_chap_auth = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_backend_name = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_clear  = zero {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_clear_ionice = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_clear_size = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_reports.file_event_handler = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_reports.log_dir           = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.backend_availability_zone = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.backend_host       = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.chap_password      = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.chap_username      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.disk_geometry      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.driver_client_cert = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.driver_data_namespace = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.extra_capabilities = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.filter_function    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.goodness_function  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.iser_helper        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.iser_ip_address    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.iser_port          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.iser_target_prefix = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.lvm_share_target   = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.lvm_type           = auto {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.num_shell_tries    = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.replication_device = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.report_discard_supported = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.reserved_percentage = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.scst_target_driver = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.storage_protocol   = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.target_helper      = lioadm {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.target_ip_address  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.target_port        = 3260 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.trace_flags        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.use_chap_auth      = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_clear       = zero {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_clear_size  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] lvmdriver-1.volumes_dir        = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl      = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_notifications.driver = [] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_notifications.retry = -1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] oslo_messaging_notifications.transport_url = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] key_manager.fixed_key          = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.barbican_api_version  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.barbican_endpoint     = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.barbican_endpoint_type = public {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.barbican_region_name  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.cafile                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.certfile              = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.collect_timing        = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.insecure              = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.keyfile               = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.number_of_retries     = 60 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.retry_delay           = 1 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.send_service_user_token = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.split_loggers         = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack sudo[83494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.timeout               = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack sudo[83494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.verify_ssl            = True {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican.verify_ssl_path       = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.auth_section = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.auth_type = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.cafile   = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.certfile = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.collect_timing = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.insecure = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.keyfile  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.split_loggers = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] barbican_service_user.timeout  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.approle_role_id          = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.approle_secret_id        = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.auth_method              = approle {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.auth_path                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.kv_mountpoint            = secret {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.kv_path                  = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.kv_version               = 2 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.namespace                = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.root_token_id            = **** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.ssl_ca_crt_file          = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.timeout                  = 60.0 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.token_file               = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.token_role               = None {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.use_ssl                  = False {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 02:59:42 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] ******************************************************************************** {{(pid=83152) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 26 02:59:42 devstack sudo[83494]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack sudo[83589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:42 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:42 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.313s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 02:59:42 devstack cinder-volume[83428]: INFO cinder.brick.local_dev.lvm [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:42 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:42 devstack sudo[83680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 02:59:42 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:43 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:43 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:43 devstack cinder-volume[83428]: DEBUG cinder.brick.local_dev.lvm [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83428) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Aug 26 02:59:43 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:43 devstack sudo[83759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:43 devstack sudo[83759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.418s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:44 devstack sudo[83759]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:44 devstack sudo[84023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:44 devstack sudo[84023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:44 devstack sudo[84023]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:44 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:44 devstack sudo[84088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Aug 26 02:59:44 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:45 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:45 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.267s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:45 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:45 devstack sudo[84091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 02:59:45 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:45 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:45 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:45 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:45 devstack sudo[84094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 02:59:45 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:45 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:45 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:45 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:45 devstack sudo[84104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:45 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:46 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:46 devstack sudo[84112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:46 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:46 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:46 devstack sudo[84116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:46 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:46 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.348s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:46 devstack cinder-volume[83428]: INFO cinder.volume.drivers.lvm [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:46 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:46 devstack sudo[84120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:46 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:47 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:47 devstack sudo[84125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 02:59:47 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:47 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:47 devstack sudo[84129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:47 devstack sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:47 devstack sudo[84129]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:47 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:47 devstack sudo[84132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:47 devstack sudo[84132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:48 devstack sudo[84132]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:48 devstack sudo[84136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:48 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:48 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:48 devstack cinder-volume[83428]: INFO cinder.volume.driver [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Driver hasn't implemented _init_vendor_properties()
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG cinder.volume.driver [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83428) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_db.sqlalchemy.engines [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83428) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writer thread running {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG cinder.db.api [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Building query based on filter {{(pid=83428) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG cinder.image.image_utils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83428) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 26 02:59:48 devstack cinder-volume[83428]: INFO cinder.keymgr.migration [None req-2a2a10f0-8b6d-4f35-9e0e-51c03077e756 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:48 devstack sudo[84142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 02:59:48 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:48 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:48 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:48 devstack sudo[84145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:48 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:49 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:49 devstack sudo[84151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:49 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:49 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:49 devstack sudo[84155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:49 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:49 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG cinder.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Notifying Schedulers of capabilities ... {{(pid=83428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 02:59:49 devstack cinder-volume[83428]: INFO cinder.volume.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Driver initialization completed successfully.
Aug 26 02:59:49 devstack cinder-volume[83428]: INFO cinder.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Initiating service 2 cleanup
Aug 26 02:59:49 devstack cinder-volume[83428]: INFO cinder.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Service 2 cleanup completed.
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG cinder.service [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Creating RPC server for service cinder-volume {{(pid=83428) start /opt/stack/cinder/cinder/service.py:231}}
Aug 26 02:59:49 devstack cinder-volume[83428]: DEBUG cinder.service [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83428) start /opt/stack/cinder/cinder/service.py:237}}
Aug 26 02:59:50 devstack cinder-volume[83428]: INFO cinder.volume.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Aug 26 02:59:50 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 02:59:50 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:50 devstack sudo[84158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 02:59:50 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:50 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:50 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:50 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:50 devstack sudo[84167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:50 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:50 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:50 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:50 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:50 devstack sudo[84171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 02:59:50 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:51 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:51 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.338s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:51 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 02:59:51 devstack sudo[84283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 02:59:51 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 02:59:51 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root
Aug 26 02:59:51 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 02:59:51 devstack cinder-volume[83428]: INFO cinder.volume.manager [None req-8ea0a7ff-4c5a-49f3-9150-0d421a903c75 None None] Driver post RPC initialization completed successfully.
Aug 26 02:59:51 devstack cinder-volume[83152]: DEBUG dbcounter [-] [83152] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 02:59:59 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writing DB stats cinder:SELECT=3 {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:00:01 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:00:25 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager._thread_info {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:00:25 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread count: 6 {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:00:25 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread info: [<_MainThread(MainThread, started 124450564747392)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124450453349568)>, <Thread(Thread-3 (stat_writer), started daemon 124450451850176)>, <Thread(Rabbit-heartbeat, started daemon 124450450548224)>, <Thread(Thread-5 (_runner), started daemon 124450449446464)>, <Thread(Thread-7 (_runner), started daemon 124450449476480)>] {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:01:25 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:01:25 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 03:01:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:01:25 devstack sudo[87085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 03:01:25 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:01:25 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root
Aug 26 03:01:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:01:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:01:25 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:01:25 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:01:26 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:01:26 devstack sudo[87409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 03:01:26 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:01:26 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:01:26 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:01:26 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:01:26 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG cinder.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Notifying Schedulers of capabilities ... {{(pid=83428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager._thread_info {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread count: 6 {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:01:26 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread info: [<_MainThread(MainThread, started 124450564747392)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124450453349568)>, <Thread(Thread-3 (stat_writer), started daemon 124450451850176)>, <Thread(Rabbit-heartbeat, started daemon 124450450548224)>, <Thread(Thread-5 (_runner), started daemon 124450449446464)>, <Thread(Thread-7 (_runner), started daemon 124450449476480)>] {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:02:01 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writing DB stats cinder:SELECT=1 {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:02:01 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writing DB stats cinder:UPDATE=1 {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:02:25 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 03:02:25 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:02:25 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:02:25 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:02:25 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:02:25 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:02:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:02:26 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 03:02:26 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:02:26 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:02:26 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:02:26 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:02:26 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG cinder.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Notifying Schedulers of capabilities ... {{(pid=83428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager._thread_info {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread count: 6 {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:02:26 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread info: [<_MainThread(MainThread, started 124450564747392)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124450453349568)>, <Thread(Thread-3 (stat_writer), started daemon 124450451850176)>, <Thread(Rabbit-heartbeat, started daemon 124450450548224)>, <Thread(Thread-5 (_runner), started daemon 124450449446464)>, <Thread(Thread-7 (_runner), started daemon 124450449476480)>] {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:03:25 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:03:25 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 03:03:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:03:25 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 03:03:25 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:03:25 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Aug 26 03:03:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:03:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:03:25 devstack sudo[92102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:03:25 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:03:26 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root
Aug 26 03:03:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:03:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:03:26 devstack sudo[92111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 03:03:26 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:03:26 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root
Aug 26 03:03:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:03:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:03:26 devstack sudo[92114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:03:26 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:03:26 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root
Aug 26 03:03:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:03:26 devstack cinder-volume[83428]: DEBUG cinder.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Notifying Schedulers of capabilities ... {{(pid=83428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:04:01 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writing DB stats cinder:SELECT=1 {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:04:01 devstack cinder-volume[83428]: DEBUG dbcounter [-] [83428] Writing DB stats cinder:UPDATE=1 {{(pid=83428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:04:25 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:04:25 devstack cinder-volume[83428]: DEBUG cinder.volume.drivers.lvm [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Updating volume stats {{(pid=83428) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 26 03:04:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:25 devstack sudo[93280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 26 03:04:25 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:25 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:25 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:25 devstack sudo[93286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:04:25 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:26 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:26 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 26 03:04:26 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:26 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:26 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 26 03:04:26 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:26 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG oslo_concurrency.processutils [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=83428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG cinder.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Notifying Schedulers of capabilities ... {{(pid=83428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG oslo_service.periodic_task [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] Running periodic task VolumeManager._thread_info {{(pid=83428) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread count: 6 {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:04:26 devstack cinder-volume[83428]: DEBUG cinder.volume.manager [None req-92275a9a-83a8-4ab8-ab1c-702ca38d7f84 None None] thread info: [<_MainThread(MainThread, started 124450564747392)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124450453349568)>, <Thread(Thread-3 (stat_writer), started daemon 124450451850176)>, <Thread(Rabbit-heartbeat, started daemon 124450450548224)>, <Thread(Thread-5 (_runner), started daemon 124450449446464)>, <Thread(Thread-7 (_runner), started daemon 124450449476480)>] {{(pid=83428) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:04:27 devstack cinder-volume[83152]: INFO oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Caught SIGTERM, stopping children
Aug 26 03:04:27 devstack cinder-volume[83152]: DEBUG oslo_concurrency.lockutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Acquiring lock "singleton_lock" {{(pid=83152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 03:04:27 devstack cinder-volume[83152]: DEBUG oslo_concurrency.lockutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Acquired lock "singleton_lock" {{(pid=83152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 03:04:27 devstack cinder-volume[83152]: DEBUG oslo_concurrency.lockutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Releasing lock "singleton_lock" {{(pid=83152) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 03:04:27 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Stop services. {{(pid=83152) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 26 03:04:27 devstack cinder-volume[83152]: DEBUG oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Killing children. {{(pid=83152) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 26 03:04:27 devstack cinder-volume[83152]: INFO oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Waiting on 1 children to exit
Aug 26 03:04:30 devstack cinder-volume[83428]: DEBUG oslo_concurrency.lockutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Acquiring lock "singleton_lock" {{(pid=83428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 03:04:30 devstack cinder-volume[83428]: DEBUG oslo_concurrency.lockutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Acquired lock "singleton_lock" {{(pid=83428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 03:04:30 devstack cinder-volume[83428]: DEBUG oslo_concurrency.lockutils [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Releasing lock "singleton_lock" {{(pid=83428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 03:04:30 devstack cinder-volume[83428]: WARNING amqp [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 03:04:30 devstack cinder-volume[83428]: WARNING amqp [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 03:04:30 devstack cinder-volume[83152]: INFO oslo_service.backend._eventlet.service [None req-7ae42f55-a6ea-4124-81df-ab31fcefc51e None None] Child 83428 exited with status 0
Aug 26 03:04:30 devstack cinder-volume[93501]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 26 03:04:30 devstack cinder-volume[93501]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 03:04:30 devstack cinder-volume[93501]: we strongly recommend against using it for new projects.
Aug 26 03:04:30 devstack cinder-volume[93501]: If you are already using Eventlet, we recommend migrating to a different
Aug 26 03:04:30 devstack cinder-volume[93501]: framework.  For more detail see
Aug 26 03:04:30 devstack cinder-volume[93501]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 03:04:30 devstack cinder-volume[93501]:   import eventlet  # noqa
Aug 26 03:04:32 devstack cinder-volume[93501]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 03:04:32 devstack cinder-volume[93501]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 03:04:32 devstack cinder-volume[93501]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 03:04:33 devstack cinder-volume[93501]: INFO dbcounter [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Registered counter for database cinder
Aug 26 03:04:33 devstack cinder-volume[93501]: DEBUG oslo_db.sqlalchemy.engines [None req-332f38d5-d042-481c-835a-16c521b1363c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG dbcounter [-] [93501] Writer thread running {{(pid=93501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 03:04:34 devstack cinder-volume[93501]: INFO cinder.rpc [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 26 03:04:34 devstack cinder-volume[93501]: INFO cinder.rpc [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_db.sqlalchemy.engines [None req-332f38d5-d042-481c-835a-16c521b1363c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:34 devstack cinder-volume[93501]: INFO cinder.volume.manager [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Determined volume DB was empty at startup.
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG cinder.volume.manager [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93501) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 26 03:04:34 devstack cinder-volume[93501]: INFO cinder.volume.manager [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 26 03:04:34 devstack cinder-volume[93501]: WARNING stevedore.named [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 03:04:34 devstack cinder-volume[93501]: WARNING castellan.key_manager [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 03:04:34 devstack cinder-volume[93501]: WARNING cinder.keymgr.conf_key_mgr [None req-332f38d5-d042-481c-835a-16c521b1363c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 03:04:34 devstack cinder-volume[93501]: INFO cinder.volume.manager [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_db.sqlalchemy.engines [None req-332f38d5-d042-481c-835a-16c521b1363c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:34 devstack cinder-volume[93501]: INFO oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Starting 1 workers
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Started child 93785 {{(pid=93501) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Full set of CONF: {{(pid=93501) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] ******************************************************************************** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Configuration options gathered from: {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] ================================================================================ {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] allow_availability_zone_fallback = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] allow_compression_on_image_upload = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] allowed_direct_url_schemes     = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] api_rate_limit                 = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] auth_strategy                  = keystone {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_availability_zone      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_host                   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_name                   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_stats_polling_interval = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backup_api_class               = cinder.backup.api.API {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backup_name_template           = backup-%s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backup_use_same_host           = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backup_use_temp_snapshot       = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] chap_password                  = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] chap_username                  =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_internal_tenant_project_id = 40d7c7d92d994b478599ce4ce8b50493 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_internal_tenant_user_id = 9a1a069e828e4a819a880dd1d37f2cf2 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cluster                        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] compression_format             = gzip {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] compute_api_class              = cinder.compute.nova.API {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] config_dir                     = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] config_source                  = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] control_exchange               = openstack {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] debug                          = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] default_availability_zone      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] default_group_type             = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] default_volume_type            = QuobyteHD {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] disk_geometry                  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] driver_client_cert             = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] driver_client_cert_key         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] driver_data_namespace          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] driver_ssl_cert_path           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] driver_ssl_cert_verify         = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] driver_use_ssl                 = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] enable_new_services            = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] enable_unsupported_driver      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93785]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] enabled_backends               = ['QuobyteHD'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] enforce_multipath_for_image_xfer = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] filter_function                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_api_insecure            = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_api_ssl_compression     = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_ca_certificates_file    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_catalog_info            = image:glance:publicURL {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_certfile                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_keyfile                 = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_num_retries             = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance_request_timeout         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] goodness_function              = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] graceful_shutdown_timeout      = 5 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] group_api_class                = cinder.group.api.API {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] host                           = devstack {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_compress_on_upload       = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_conversion_address_space_limit = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_conversion_cpu_limit     = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_conversion_disable       = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_upload_use_cinder_backend = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_upload_use_internal_tenant = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_volume_cache_enabled     = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_volume_cache_max_count   = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] image_volume_cache_max_size_gb = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] init_host_max_objects_retrieval = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] instance_format                = [instance: %(uuid)s]  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] iscsi_target_flags             =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] iscsi_write_cache              = on {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] iser_helper                    = tgtadm {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] iser_ip_address                = 192.168.122.19 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] iser_port                      = 3260 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_color                      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_config_append              = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_dir                        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_file                       = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_options                    = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_rotate_interval            = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_rotate_interval_type       = days {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] log_rotation_type              = none {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] max_age                        = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] max_logfile_count              = 30 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] max_logfile_size_mb            = 200 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] max_over_subscription_ratio    = 20.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] message_reap_interval          = 86400 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] message_ttl                    = 2592000 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] migration_create_volume_timeout_secs = 300 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] monkey_patch                   = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] monkey_patch_modules           = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] my_ip                          = 192.168.122.19 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] no_snapshot_gb_quota           = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] num_iser_scan_tries            = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] num_shell_tries                = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] num_volume_device_scan_tries   = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] nvmeof_conn_info_version       = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] nvmet_ns_id                    = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] nvmet_port_id                  = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_max_limit                = 1000 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_volume_ext_list          = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_volume_listen_port       = 8776 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_volume_use_ssl           = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] osapi_volume_workers           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] per_volume_size_limit          = -1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] periodic_fuzzy_delay           = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] periodic_interval              = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] public_endpoint                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] publish_errors                 = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_backup_gigabytes         = 1000 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_backups                  = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_gigabytes                = 1000 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_groups                   = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_snapshots                = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] quota_volumes                  = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] rate_limit_burst               = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] rate_limit_except_level        = CRITICAL {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] rate_limit_interval            = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] reinit_driver_count            = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] replication_device             = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] report_discard_supported       = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] report_interval                = 120 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] reservation_clean_interval     = 86400 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] reservation_expire             = 86400 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] reserved_image_namespaces      = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] reserved_percentage            = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] rpc_response_timeout           = 120 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] run_external_periodic_tasks    = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] scst_target_driver             = iscsi {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] scst_target_iqn_name           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_down_time              = 720 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] shell_completion               = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] snapshot_name_template         = snapshot-%s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] split_loggers                  = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] state_path                     = /opt/stack/data/cinder {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] storage_availability_zone      = nova {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] storage_protocol               = iSCSI {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] syslog_log_facility            = LOG_USER {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] target_helper                  = lioadm {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] target_ip_address              = 192.168.122.19 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] target_port                    = 3260 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] target_protocol                = iscsi {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] target_secondary_ip_addresses  = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] trace_flags                    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] transport_url                  = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] until_refresh                  = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_chap_auth                  = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_default_quota_class        = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_journal                    = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_json                       = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_multipath_for_image_xfer   = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_stderr                     = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93785]: INFO cinder.volume.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Starting volume driver QuobyteDriver (1.2.1)
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] use_syslog                     = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.remotefs [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93785) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] verify_glance_signatures       = enabled {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_api_class               = cinder.volume.api.API {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_backend_name            = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_clear                   = zero {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_clear_ionice            = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_clear_size              = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_copy_bps_limit          = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_dd_blocksize            = 1M {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_name_template           = volume-%s {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_service_inithost_offload = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volume_usage_audit_period      = month {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] zoning_mode                    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_concurrency.disable_process_locking = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.auth_section = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.auth_type   = password {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.auth_version = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.cache       = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.certfile    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.delay_auth_decision = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.http_connect_timeout = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.include_service_catalog = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.insecure    = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.interface   = public {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.keyfile     = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_password = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcache_username = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.region_name = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.service_token_roles_required = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.service_type = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.token_cache_time = 300 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.backend                  = dogpile.cache.null {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.backend_argument         = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.backend_expiration_time  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.config_prefix            = cache.oslo {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.debug_cache_backend      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.enable_retry_client      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.enable_socket_keepalive  = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.enabled                  = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.expiration_time          = 600 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.hashclient_retry_attempts = 2 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_dead_retry      = 300 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_pool_maxsize    = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_sasl_enabled    = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.password                 = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.proxies                  = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.redis_db                 = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.redis_sentinel_service_name = mymaster {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.redis_server             = localhost:6379 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.retry_attempts           = 2 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.retry_delay              = 0.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.socket_keepalive_count   = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.socket_keepalive_idle    = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.socket_keepalive_interval = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.socket_timeout           = 1.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.tls_allowed_ciphers      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.tls_cafile               = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.tls_certfile             = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.tls_enabled              = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.tls_keyfile              = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cache.username                 = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] coordination.backend_url       = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.asyncio_connection    = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.asyncio_slave_connection = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.backend               = sqlalchemy {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.connection            = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.connection_debug      = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.connection_parameters =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.connection_recycle_time = 3600 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.connection_trace      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.db_inc_retry_interval = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.db_max_retries        = 20 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.db_max_retry_interval = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.db_retry_interval     = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.max_overflow          = 50 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.max_pool_size         = 5 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.max_retries           = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.mysql_wsrep_sync_wait = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.pool_timeout          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.retry_interval        = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.slave_connection      = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.sqlite_synchronous    = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.synchronous_reader    = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] database.use_db_reconnect      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.connection_string     = messaging:// {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.enabled               = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.es_doc_type           = notification {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.es_scroll_size        = 10000 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.es_scroll_time        = 2m {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.filter_error_trace    = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.hmac_keys             = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.sentinel_service_name = mymaster {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.socket_timeout        = 0.1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.trace_requests        = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler.trace_sqlalchemy      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler_jaeger.process_tags   = {} {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler_jaeger.service_name_prefix = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] profiler_otlp.service_name_prefix = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.enforce_new_defaults = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.policy_default_rule = default {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.policy_file        = policy.yaml {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.group          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.helper_command = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] privsep_osbrick.user           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.group         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.helper_command = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] cinder_sys_admin.user          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.auth_section      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.auth_type         = password {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.cafile            = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.certfile          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.collect_timing    = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.insecure          = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.keyfile           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.send_service_user_token = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.split_loggers     = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] service_user.timeout           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.auth_section            = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.auth_type               = password {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.certfile                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.collect_timing          = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.insecure                = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.keyfile                 = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.region_name             = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.split_loggers           = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] glance.timeout                 = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.backend_availability_zone = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.chap_password = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.chap_username =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.disk_geometry = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.driver_client_cert = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.driver_client_cert_key = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.driver_data_namespace = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.driver_use_ssl = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.enable_unsupported_driver = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.extra_capabilities = {} {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.filter_function = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.goodness_function = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.iscsi_target_flags =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.iscsi_write_cache = on {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.iser_helper   = tgtadm {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.iser_port     = 3260 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_host      =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_login     = admin {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_mount_options = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_password  = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_private_key =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_share_path =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.num_shell_tries = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.nvmet_port_id = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_client_cfg = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.quobyte_volume_url = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.replication_device = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.report_discard_supported = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.reserved_percentage = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.scst_target_driver = iscsi {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.scst_target_iqn_name = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.storage_protocol = iSCSI {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.target_helper = tgtadm {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.target_port   = 3260 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.target_protocol = iscsi {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.trace_flags   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.unique_fqdn_network = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.use_chap_auth = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_backend_name = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_clear  = zero {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_clear_ionice = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_clear_size = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_reports.file_event_handler = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_reports.log_dir           = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.backend_availability_zone = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.backend_host         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.chap_password        = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.chap_username        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.chiscsi_conf         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.disk_geometry        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.driver_client_cert   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.driver_client_cert_key = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.driver_data_namespace = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.driver_use_ssl       = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.extra_capabilities   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93785) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Aug 26 03:04:34 devstack cinder-volume[93785]: WARNING cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.filter_function      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.goodness_function    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93785]: WARNING cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.iser_helper          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.iser_ip_address      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.iser_port            = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.iser_target_prefix   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_host             = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_login            = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_mount_options    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_password         = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_private_key      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Running cmd (subprocess): mount.quobyte {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_share_path       = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_ssh_port         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.num_shell_tries      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.nvmet_port_id        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.replication_device   = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.report_discard_supported = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.reserved_percentage  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.scst_target_driver   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.storage_protocol     = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.target_helper        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.target_ip_address    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.target_port          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.target_prefix        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.target_protocol      = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.trace_flags          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.use_chap_auth        = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_clear         = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_clear_size    = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] QuobyteHD.volumes_dir          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl      = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_notifications.driver = [] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_notifications.retry = -1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] oslo_messaging_notifications.transport_url = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] key_manager.fixed_key          = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.barbican_api_version  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.barbican_endpoint     = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.barbican_endpoint_type = public {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.barbican_region_name  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.cafile                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.certfile              = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.collect_timing        = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.insecure              = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.keyfile               = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.number_of_retries     = 60 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.retry_delay           = 1 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.send_service_user_token = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.split_loggers         = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.timeout               = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.verify_ssl            = True {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican.verify_ssl_path       = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.auth_section = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.auth_type = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.cafile   = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.certfile = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.collect_timing = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.insecure = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.keyfile  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.split_loggers = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] barbican_service_user.timeout  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.approle_role_id          = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.approle_secret_id        = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.auth_method              = approle {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.auth_path                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.kv_mountpoint            = secret {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.kv_path                  = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.kv_version               = 2 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.namespace                = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.root_token_id            = **** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.ssl_ca_crt_file          = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.timeout                  = 60.0 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.token_file               = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.token_role               = None {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.use_ssl                  = False {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:34 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] ******************************************************************************** {{(pid=93501) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 26 03:04:34 devstack quobyte-client[93786]: Reading configuration file: /etc/quobyte/client.cfg
Aug 26 03:04:34 devstack quobyte-client[93786]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=93785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:34 devstack cinder-volume[93785]: INFO cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 ...
Aug 26 03:04:34 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 -c /etc/quobyte/client-cinder.cfg {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:35 devstack sudo[93787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 -c /etc/quobyte/client-cinder.cfg
Aug 26 03:04:35 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:35 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:35 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.560s {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:35 devstack cinder-volume[93785]: INFO cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 succeeded
Aug 26 03:04:35 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=93785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:35 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.573s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:35 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:35 devstack sudo[93864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:35 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:35 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:35 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.328s {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:35 devstack cinder-volume[93785]: INFO cinder.volume.driver [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Driver hasn't implemented _init_vendor_properties()
Aug 26 03:04:35 devstack cinder-volume[93785]: DEBUG cinder.volume.driver [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.824909210205, 'free_capacity_gb': 1774.824909210205, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93785) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_db.sqlalchemy.engines [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG dbcounter [-] [93785] Writer thread running {{(pid=93785) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.db.api [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Building query based on filter {{(pid=93785) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.image.image_utils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93785) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 26 03:04:36 devstack cinder-volume[93785]: INFO cinder.keymgr.migration [None req-2da3cd3d-9354-4fb9-99c0-f1f080fc06e2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=93785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=93785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:36 devstack sudo[93900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:36 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:36 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.280s {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Notifying Schedulers of capabilities ... {{(pid=93785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:04:36 devstack cinder-volume[93785]: INFO cinder.volume.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Driver initialization completed successfully.
Aug 26 03:04:36 devstack cinder-volume[93785]: INFO cinder.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Initiating service 3 cleanup
Aug 26 03:04:36 devstack cinder-volume[93785]: INFO cinder.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Service 3 cleanup completed.
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.service [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Creating RPC server for service cinder-volume {{(pid=93785) start /opt/stack/cinder/cinder/service.py:231}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.service [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93785) start /opt/stack/cinder/cinder/service.py:237}}
Aug 26 03:04:36 devstack cinder-volume[93785]: INFO cinder.volume.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=93785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=93785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:36 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:36 devstack sudo[93965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:36 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:37 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:37 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.385s {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:37 devstack cinder-volume[93785]: INFO cinder.volume.manager [None req-48aae52d-ce2b-4d87-b1c9-204db23974cf None None] Driver post RPC initialization completed successfully.
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=93785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG cinder.volume.drivers.quobyte [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=93785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93785) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:40 devstack sudo[94071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:40 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:40 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG oslo_concurrency.processutils [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.242s {{(pid=93785) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:40 devstack cinder-volume[93785]: DEBUG cinder.manager [None req-9c38497d-df9f-440f-8037-425ccaf92e43 None None] Notifying Schedulers of capabilities ... {{(pid=93785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:04:43 devstack cinder-volume[93501]: INFO oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Caught SIGTERM, stopping children
Aug 26 03:04:43 devstack cinder-volume[93501]: DEBUG oslo_concurrency.lockutils [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Acquiring lock "singleton_lock" {{(pid=93501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 03:04:43 devstack cinder-volume[93501]: DEBUG oslo_concurrency.lockutils [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Acquired lock "singleton_lock" {{(pid=93501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 03:04:43 devstack cinder-volume[93501]: DEBUG oslo_concurrency.lockutils [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Releasing lock "singleton_lock" {{(pid=93501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 03:04:43 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Stop services. {{(pid=93501) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 26 03:04:43 devstack cinder-volume[93501]: DEBUG oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Killing children. {{(pid=93501) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 26 03:04:43 devstack cinder-volume[93501]: INFO oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Waiting on 1 children to exit
Aug 26 03:04:45 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Acquiring lock "singleton_lock" {{(pid=93785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 03:04:45 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Acquired lock "singleton_lock" {{(pid=93785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 03:04:45 devstack cinder-volume[93785]: DEBUG oslo_concurrency.lockutils [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Releasing lock "singleton_lock" {{(pid=93785) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 03:04:45 devstack cinder-volume[93785]: WARNING amqp [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 03:04:45 devstack cinder-volume[93785]: WARNING amqp [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 26 03:04:45 devstack cinder-volume[93501]: INFO oslo_service.backend._eventlet.service [None req-332f38d5-d042-481c-835a-16c521b1363c None None] Child 93785 exited with status 0
Aug 26 03:04:45 devstack cinder-volume[94159]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 26 03:04:45 devstack cinder-volume[94159]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 03:04:45 devstack cinder-volume[94159]: we strongly recommend against using it for new projects.
Aug 26 03:04:45 devstack cinder-volume[94159]: If you are already using Eventlet, we recommend migrating to a different
Aug 26 03:04:45 devstack cinder-volume[94159]: framework.  For more detail see
Aug 26 03:04:45 devstack cinder-volume[94159]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 03:04:45 devstack cinder-volume[94159]:   import eventlet  # noqa
Aug 26 03:04:48 devstack cinder-volume[94159]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94159) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 26 03:04:48 devstack cinder-volume[94159]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94159) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 26 03:04:48 devstack cinder-volume[94159]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94159) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 26 03:04:50 devstack cinder-volume[94159]: INFO dbcounter [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Registered counter for database cinder
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_db.sqlalchemy.engines [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94159) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG dbcounter [-] [94159] Writer thread running {{(pid=94159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 03:04:50 devstack cinder-volume[94159]: INFO cinder.rpc [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 26 03:04:50 devstack cinder-volume[94159]: INFO cinder.rpc [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_db.sqlalchemy.engines [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94159) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:50 devstack cinder-volume[94159]: INFO cinder.volume.manager [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Determined volume DB was empty at startup.
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG cinder.volume.manager [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94159) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 26 03:04:50 devstack cinder-volume[94159]: WARNING stevedore.named [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 26 03:04:50 devstack cinder-volume[94159]: WARNING castellan.key_manager [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 03:04:50 devstack cinder-volume[94159]: WARNING cinder.keymgr.conf_key_mgr [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 26 03:04:50 devstack cinder-volume[94159]: INFO cinder.volume.manager [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_db.sqlalchemy.engines [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94159) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:50 devstack cinder-volume[94159]: INFO oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Starting 1 workers
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Started child 94326 {{(pid=94159) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Full set of CONF: {{(pid=94159) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] ******************************************************************************** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] Configuration options gathered from: {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] ================================================================================ {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] allow_availability_zone_fallback = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] allow_compression_on_image_upload = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] allowed_direct_url_schemes     = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] api_rate_limit                 = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] auth_strategy                  = keystone {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_availability_zone      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_host                   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_name                   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_stats_polling_interval = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backup_api_class               = cinder.backup.api.API {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backup_name_template           = backup-%s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backup_use_same_host           = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backup_use_temp_snapshot       = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] chap_password                  = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] chap_username                  =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_internal_tenant_project_id = 40d7c7d92d994b478599ce4ce8b50493 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_internal_tenant_user_id = 9a1a069e828e4a819a880dd1d37f2cf2 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cluster                        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] compression_format             = gzip {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] compute_api_class              = cinder.compute.nova.API {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] config_dir                     = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] config_source                  = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] control_exchange               = openstack {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] debug                          = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] default_availability_zone      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] default_group_type             = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] default_volume_type            = QuobyteHD {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94326]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] disk_geometry                  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] driver_client_cert             = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] driver_client_cert_key         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] driver_data_namespace          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] driver_ssl_cert_path           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] driver_ssl_cert_verify         = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] driver_use_ssl                 = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] enable_new_services            = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] enable_unsupported_driver      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] enabled_backends               = ['QuobyteHD'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] enforce_multipath_for_image_xfer = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] filter_function                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_api_insecure            = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_api_ssl_compression     = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_ca_certificates_file    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_catalog_info            = image:glance:publicURL {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_certfile                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_keyfile                 = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_num_retries             = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance_request_timeout         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] goodness_function              = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] graceful_shutdown_timeout      = 5 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] group_api_class                = cinder.group.api.API {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] host                           = devstack {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_compress_on_upload       = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_conversion_address_space_limit = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_conversion_cpu_limit     = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_conversion_disable       = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_upload_use_cinder_backend = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_upload_use_internal_tenant = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_volume_cache_enabled     = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_volume_cache_max_count   = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] image_volume_cache_max_size_gb = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] init_host_max_objects_retrieval = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] instance_format                = [instance: %(uuid)s]  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] iscsi_target_flags             =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] iscsi_write_cache              = on {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] iser_helper                    = tgtadm {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] iser_ip_address                = 192.168.122.19 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] iser_port                      = 3260 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_color                      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_config_append              = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_dir                        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_file                       = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_options                    = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_rotate_interval            = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_rotate_interval_type       = days {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] log_rotation_type              = none {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] max_age                        = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] max_logfile_count              = 30 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] max_logfile_size_mb            = 200 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] max_over_subscription_ratio    = 20.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] message_reap_interval          = 86400 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] message_ttl                    = 2592000 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] migration_create_volume_timeout_secs = 300 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] monkey_patch                   = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] monkey_patch_modules           = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] my_ip                          = 192.168.122.19 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] no_snapshot_gb_quota           = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] num_iser_scan_tries            = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] num_shell_tries                = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] num_volume_device_scan_tries   = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] nvmeof_conn_info_version       = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] nvmet_ns_id                    = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] nvmet_port_id                  = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_max_limit                = 1000 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_volume_ext_list          = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:50 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_volume_listen_port       = 8776 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_volume_use_ssl           = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] osapi_volume_workers           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] per_volume_size_limit          = -1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] periodic_fuzzy_delay           = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] periodic_interval              = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] public_endpoint                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] publish_errors                 = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_backup_gigabytes         = 1000 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_backups                  = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_gigabytes                = 1000 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_groups                   = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_snapshots                = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] quota_volumes                  = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] rate_limit_burst               = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] rate_limit_except_level        = CRITICAL {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] rate_limit_interval            = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] reinit_driver_count            = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] replication_device             = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] report_discard_supported       = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] report_interval                = 120 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] reservation_clean_interval     = 86400 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] reservation_expire             = 86400 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] reserved_image_namespaces      = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] reserved_percentage            = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] rpc_response_timeout           = 120 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] run_external_periodic_tasks    = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] scst_target_driver             = iscsi {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] scst_target_iqn_name           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_down_time              = 720 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] shell_completion               = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] snapshot_name_template         = snapshot-%s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] split_loggers                  = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] state_path                     = /opt/stack/data/cinder {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] storage_availability_zone      = nova {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] storage_protocol               = iSCSI {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] syslog_log_facility            = LOG_USER {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] target_helper                  = lioadm {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] target_ip_address              = 192.168.122.19 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] target_port                    = 3260 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] target_protocol                = iscsi {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] target_secondary_ip_addresses  = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] trace_flags                    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] transport_url                  = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] until_refresh                  = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_chap_auth                  = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_default_quota_class        = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_journal                    = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_json                       = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_multipath_for_image_xfer   = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_stderr                     = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] use_syslog                     = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] verify_glance_signatures       = enabled {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_api_class               = cinder.volume.api.API {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_backend_name            = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_clear                   = zero {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_clear_ionice            = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_clear_size              = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_copy_bps_limit          = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_dd_blocksize            = 1M {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_name_template           = volume-%s {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_service_inithost_offload = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volume_usage_audit_period      = month {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] zoning_mode                    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_concurrency.disable_process_locking = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.auth_section = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.auth_type   = password {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.auth_version = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.cache       = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.certfile    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.include_service_catalog = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.insecure    = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.interface   = public {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.keyfile     = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_password = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcache_username = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.region_name = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.service_type = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.backend                  = dogpile.cache.null {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.backend_argument         = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.backend_expiration_time  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.config_prefix            = cache.oslo {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.debug_cache_backend      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.enable_retry_client      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.enable_socket_keepalive  = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.enabled                  = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.expiration_time          = 600 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.hashclient_retry_attempts = 2 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_dead_retry      = 300 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_pool_maxsize    = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_sasl_enabled    = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.password                 = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.proxies                  = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.redis_db                 = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.redis_server             = localhost:6379 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.retry_attempts           = 2 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.retry_delay              = 0.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.socket_keepalive_count   = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.socket_keepalive_idle    = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.socket_keepalive_interval = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.socket_timeout           = 1.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.tls_allowed_ciphers      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.tls_cafile               = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.tls_certfile             = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.tls_enabled              = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.tls_keyfile              = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cache.username                 = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] coordination.backend_url       = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.asyncio_connection    = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.asyncio_slave_connection = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.backend               = sqlalchemy {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.connection            = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.connection_debug      = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.connection_parameters =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.connection_recycle_time = 3600 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.connection_trace      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.db_inc_retry_interval = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.db_max_retries        = 20 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.db_max_retry_interval = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.db_retry_interval     = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.max_overflow          = 50 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.max_pool_size         = 5 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.max_retries           = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.mysql_wsrep_sync_wait = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.pool_timeout          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.retry_interval        = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.slave_connection      = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.sqlite_synchronous    = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.synchronous_reader    = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] database.use_db_reconnect      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.connection_string     = messaging:// {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.enabled               = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.es_doc_type           = notification {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.es_scroll_size        = 10000 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.es_scroll_time        = 2m {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.filter_error_trace    = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.hmac_keys             = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.sentinel_service_name = mymaster {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.socket_timeout        = 0.1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.trace_requests        = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler.trace_sqlalchemy      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler_jaeger.process_tags   = {} {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler_jaeger.service_name_prefix = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] profiler_otlp.service_name_prefix = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.enforce_new_defaults = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.policy_default_rule = default {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.policy_file        = policy.yaml {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Starting volume driver QuobyteDriver (1.2.1)
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94326) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.group          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.helper_command = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] privsep_osbrick.user           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.group         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.helper_command = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] cinder_sys_admin.user          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.auth_section      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.auth_type         = password {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.cafile            = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.certfile          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.collect_timing    = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.insecure          = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.keyfile           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.send_service_user_token = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.split_loggers     = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] service_user.timeout           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.auth_section            = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.auth_type               = password {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.certfile                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.collect_timing          = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.insecure                = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.keyfile                 = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.region_name             = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.split_loggers           = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] glance.timeout                 = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.backend_availability_zone = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.chap_password = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.chap_username =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.disk_geometry = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.driver_client_cert = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.driver_client_cert_key = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.driver_data_namespace = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.driver_use_ssl = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.extra_capabilities = {} {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.filter_function = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.goodness_function = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.iscsi_target_flags =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.iscsi_write_cache = on {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.iser_helper   = tgtadm {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.iser_port     = 3260 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_host      =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_login     = admin {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_mount_options = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_password  = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_private_key =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_share_path =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.num_shell_tries = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.quobyte_volume_url = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.replication_device = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.report_discard_supported = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.reserved_percentage = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.target_helper = tgtadm {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.target_port   = 3260 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.target_protocol = iscsi {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.trace_flags   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.unique_fqdn_network = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.use_chap_auth = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_backend_name = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_clear  = zero {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_clear_ionice = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_clear_size = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_reports.file_event_handler = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_reports.log_dir           = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.backend_availability_zone = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.backend_host         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.chap_password        = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.chap_username        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.chiscsi_conf         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.disk_geometry        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.driver_client_cert   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.driver_data_namespace = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.driver_use_ssl       = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.extra_capabilities   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.filter_function      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.goodness_function    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.iser_helper          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.iser_ip_address      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.iser_port            = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.iser_target_prefix   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_host             = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_login            = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_mount_options    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_password         = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_private_key      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_share_path       = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_ssh_port         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.num_shell_tries      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.nvmet_port_id        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.replication_device   = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.report_discard_supported = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.reserved_percentage  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.scst_target_driver   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.storage_protocol     = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.target_helper        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.target_ip_address    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.target_port          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.target_prefix        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.target_protocol      = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.trace_flags          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.use_chap_auth        = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_clear         = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_clear_size    = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] QuobyteHD.volumes_dir          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl      = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_notifications.driver = [] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_notifications.retry = -1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] key_manager.fixed_key          = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.barbican_api_version  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.barbican_endpoint     = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.barbican_endpoint_type = public {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.barbican_region_name  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.cafile                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.certfile              = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.collect_timing        = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.insecure              = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.keyfile               = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.number_of_retries     = 60 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.retry_delay           = 1 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.send_service_user_token = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.split_loggers         = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.timeout               = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.verify_ssl            = True {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican.verify_ssl_path       = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.auth_section = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.auth_type = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.cafile   = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.certfile = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.collect_timing = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.insecure = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.keyfile  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.split_loggers = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] barbican_service_user.timeout  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.approle_role_id          = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.approle_secret_id        = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.auth_method              = approle {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.auth_path                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.kv_mountpoint            = secret {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.kv_path                  = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.kv_version               = 2 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.namespace                = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.root_token_id            = **** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.ssl_ca_crt_file          = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.timeout                  = 60.0 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.token_file               = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.token_role               = None {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.use_ssl                  = False {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Aug 26 03:04:51 devstack cinder-volume[94159]: DEBUG oslo_service.backend._eventlet.service [None req-4086036f-4ef5-4269-a611-66cf056fb934 None None] ******************************************************************************** {{(pid=94159) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94326) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Aug 26 03:04:51 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 26 03:04:51 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Running cmd (subprocess): mount.quobyte {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:51 devstack quobyte-client[94329]: Reading configuration file: /etc/quobyte/client.cfg
Aug 26 03:04:51 devstack quobyte-client[94329]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:51 devstack sudo[94330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:51 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.295s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:51 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:51 devstack cinder-volume[94326]: INFO cinder.volume.driver [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Driver hasn't implemented _init_vendor_properties()
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.driver [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6434135437012, 'free_capacity_gb': 1774.6434135437012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94326) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_db.sqlalchemy.engines [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writer thread running {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.db.api [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Building query based on filter {{(pid=94326) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94326) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:51 devstack cinder-volume[94326]: INFO cinder.keymgr.migration [None req-c4164d33-0abd-47e2-83c8-1cfc8b98a30a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 26 03:04:51 devstack sudo[94371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:51 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:52 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.310s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:04:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Driver initialization completed successfully.
Aug 26 03:04:52 devstack cinder-volume[94326]: INFO cinder.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Initiating service 3 cleanup
Aug 26 03:04:52 devstack cinder-volume[94326]: INFO cinder.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Service 3 cleanup completed.
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG cinder.service [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Creating RPC server for service cinder-volume {{(pid=94326) start /opt/stack/cinder/cinder/service.py:231}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG cinder.service [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94326) start /opt/stack/cinder/cinder/service.py:237}}
Aug 26 03:04:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:04:52 devstack sudo[94416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:04:52 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:04:52 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root
Aug 26 03:04:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.266s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:04:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6b39887c-5d16-4c71-8cea-88bc2143557b None None] Driver post RPC initialization completed successfully.
Aug 26 03:05:00 devstack cinder-volume[94159]: DEBUG dbcounter [-] [94159] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:05:02 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:05:02 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=2 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:05:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:05:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 6 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:05:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Flow 'volume_create_manager' (e6738ed9-22c7-47c8-b732-be51af932584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d7abef-a329-434d-91bd-fedefe34edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d7abef-a329-434d-91bd-fedefe34edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1970727586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e1dadaa0684c23a7fd86514882b5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:52Z,use_quota=True,user_id='b38d90690d93445c9429d78f91b5b34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155fb001-1e4a-4b88-8026-755ad27423a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155fb001-1e4a-4b88-8026-755ad27423a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca77f91-9f10-4ce8-9417-5c663d11e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca77f91-9f10-4ce8-9417-5c663d11e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57', 'volume_name': 'volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44c3aba-859a-4484-ac89-f1149c192e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44c3aba-859a-4484-ac89-f1149c192e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710a012-e571-430c-95f1-2223a77a9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:52 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Volume 7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57', 'volume_size': 1}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1970727586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e1dadaa0684c23a7fd86514882b5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:52Z,use_quota=True,user_id='b38d90690d93445c9429d78f91b5b34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Creating volume 7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:05:52 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:05:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:05:52 devstack sudo[94967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 1073741824
Aug 26 03:05:52 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:05:53 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root
Aug 26 03:05:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 1073741824" returned: 0 in 1.111s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Flow 'volume_create_manager' (231c310b-0c73-4a18-864e-6e4727767688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ef653f-fd3b-40b1-ba5e-4c697a98f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ef653f-fd3b-40b1-ba5e-4c697a98f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1586525138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89ba3e3-6eef-44fd-b159-4d013b336aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd74bb7df1e45fb907ee2cbd5132eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:54Z,use_quota=True,user_id='1b9c4042628e4775a7fffa19c0976613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174ea0ab-1b3a-4bd1-b8ff-91da21b10d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174ea0ab-1b3a-4bd1-b8ff-91da21b10d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d715b792-72ed-4b18-9cf7-50775e75d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d715b792-72ed-4b18-9cf7-50775e75d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89ba3e3-6eef-44fd-b159-4d013b336aac', 'volume_name': 'volume-f89ba3e3-6eef-44fd-b159-4d013b336aac', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc45e664-4071-4241-97cd-0ff2379148d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc45e664-4071-4241-97cd-0ff2379148d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2f99ff-cbce-4850-b7af-9a67f81f52ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:54 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Volume f89ba3e3-6eef-44fd-b159-4d013b336aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89ba3e3-6eef-44fd-b159-4d013b336aac', 'volume_size': 1}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:05:54 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57
Aug 26 03:05:54 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:05:54 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57" returned: 0 in 0.544s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1586525138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89ba3e3-6eef-44fd-b159-4d013b336aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd74bb7df1e45fb907ee2cbd5132eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:54Z,use_quota=True,user_id='1b9c4042628e4775a7fffa19c0976613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Creating volume f89ba3e3-6eef-44fd-b159-4d013b336aac {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:05:54 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:05:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710a012-e571-430c-95f1-2223a77a9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:55 devstack sudo[95290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac 1073741824
Aug 26 03:05:55 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:05:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e8b363-0a40-4505-83b9-ae98a4010697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Volume volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 (7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57): created successfully
Aug 26 03:05:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e8b363-0a40-4505-83b9-ae98a4010697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Flow 'volume_create_manager' (e6738ed9-22c7-47c8-b732-be51af932584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:05:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e01e1827-840c-4f6e-a6a3-8ca022b3cec8 tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Created volume successfully.
Aug 26 03:05:55 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root
Aug 26 03:05:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac 1073741824" returned: 0 in 0.830s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:05:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:05:55 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac
Aug 26 03:05:55 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:05:56 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac" returned: 0 in 0.628s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2f99ff-cbce-4850-b7af-9a67f81f52ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89ba3e3-6eef-44fd-b159-4d013b336aac', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea74046-649c-4d5d-9b4c-98d6fd490f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:05:56 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Volume volume-f89ba3e3-6eef-44fd-b159-4d013b336aac (f89ba3e3-6eef-44fd-b159-4d013b336aac): created successfully
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea74046-649c-4d5d-9b4c-98d6fd490f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:05:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Flow 'volume_create_manager' (231c310b-0c73-4a18-864e-6e4727767688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:05:56 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-43d4e63a-59b0-4669-a87e-2825645334a9 tempest-DeleteServersTestJSON-1533405207 None] Created volume successfully.
Aug 26 03:05:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Acquiring lock "cinder-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:05:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "cinder-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:05:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Acquiring lock "cinder-quobyte-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:05:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "cinder-quobyte-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57" acquired by "delete_volume" :: waited 0.059s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:05:58 devstack cinder-volume[94326]: INFO oslo.privsep.daemon [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp06wkllof/privsep.sock']
Aug 26 03:05:58 devstack sudo[95307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp06wkllof/privsep.sock
Aug 26 03:05:58 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 26 03:06:00 devstack cinder-volume[94326]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Aug 26 03:06:00 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:00 devstack cinder-volume[94326]: INFO oslo.privsep.daemon [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Spawned new privsep daemon via rootwrap
Aug 26 03:06:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Accepted privsep connection to /tmp/tmp06wkllof/privsep.sock {{(pid=94326) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Aug 26 03:06:00 devstack cinder-volume[94326]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 03:06:00 devstack cinder-volume[94326]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 03:06:00 devstack cinder-volume[94326]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 03:06:00 devstack cinder-volume[94326]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95315
Aug 26 03:06:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c6cb0-e519-44b5-8490-dbf860f64d59]: (2,) {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:06:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec3881e-01f3-4540-a615-5f3b5ac7e53b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:06:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:01 devstack sudo[95317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57
Aug 26 03:06:01 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:01 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57" returned: 0 in 0.578s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:01 devstack sudo[95323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57
Aug 26 03:06:01 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:01 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "cinder-quobyte-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57" released by "delete_volume" :: held 3.278s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:06:01 devstack cinder-volume[94326]: WARNING cinder.quota [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:06:01 devstack cinder-volume[94326]: WARNING cinder.quota [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:06:01 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Created reservations ['0e03a7de-c80a-477d-a06b-a6fac33bb477', 'c5f629be-2c12-4b47-ab61-21daa816a50f', '721ef2a4-0d41-4b27-badb-50fb6a9ddcca', 'dff344c9-5024-41e2-94a1-98bf35ea4847'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:02 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:06:02 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:02 devstack cinder-volume[94326]: WARNING py.warnings [req-29ab389d-ec2f-4e6f-9a18-7d4ccac2ea7e req-639685b8-279f-4c1b-b40b-d5fd27a5a5d3 tempest-DeleteServersTestJSON-1533405207 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Aug 26 03:06:02 devstack cinder-volume[94326]:   .first()
Aug 26 03:06:02 devstack cinder-volume[94326]: 
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-29ab389d-ec2f-4e6f-9a18-7d4ccac2ea7e req-639685b8-279f-4c1b-b40b-d5fd27a5a5d3 tempest-DeleteServersTestJSON-1533405207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-29ab389d-ec2f-4e6f-9a18-7d4ccac2ea7e req-639685b8-279f-4c1b-b40b-d5fd27a5a5d3 tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-29ab389d-ec2f-4e6f-9a18-7d4ccac2ea7e req-639685b8-279f-4c1b-b40b-d5fd27a5a5d3 tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-29ab389d-ec2f-4e6f-9a18-7d4ccac2ea7e req-639685b8-279f-4c1b-b40b-d5fd27a5a5d3 tempest-DeleteServersTestJSON-1533405207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-f89ba3e3-6eef-44fd-b159-4d013b336aac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '121cebde-3e4c-402b-8658-820ccfc9ba36', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:06:02 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.658s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:06:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Deleted volume successfully.
Aug 26 03:06:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9007e79a-d2ad-45e9-a2af-9f73809d7aaf tempest-VolumeQuotasNegativeTestJSON-1255304252 None] Lock "cinder-7e2d9f39-48a0-41e9-af7c-3b1d4ce70d57-delete_volume" released by "delete_volume" :: held 4.602s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:06:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-29ab389d-ec2f-4e6f-9a18-7d4ccac2ea7e req-639685b8-279f-4c1b-b40b-d5fd27a5a5d3 tempest-DeleteServersTestJSON-1533405207 None] attachment_update completed successfully.
Aug 26 03:06:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-739dece2-f185-4fa0-9824-57230cc876dd req-7e0bf454-68ad-4d03-b95b-0f1e08731899 tempest-DeleteServersTestJSON-1533405207 None] Terminate volume connection completed successfully.
Aug 26 03:06:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-739dece2-f185-4fa0-9824-57230cc876dd req-7e0bf454-68ad-4d03-b95b-0f1e08731899 tempest-DeleteServersTestJSON-1533405207 None] Deleting attachment 121cebde-3e4c-402b-8658-820ccfc9ba36. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Acquiring lock "cinder-f89ba3e3-6eef-44fd-b159-4d013b336aac-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Lock "cinder-f89ba3e3-6eef-44fd-b159-4d013b336aac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Acquiring lock "cinder-quobyte-f89ba3e3-6eef-44fd-b159-4d013b336aac" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Lock "cinder-quobyte-f89ba3e3-6eef-44fd-b159-4d013b336aac" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b711886c-b91f-4228-9e1f-b4a3201ac5a9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:10 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac
Aug 26 03:06:10 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:10 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:10 devstack sudo[95865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac
Aug 26 03:06:10 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:11 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f89ba3e3-6eef-44fd-b159-4d013b336aac" returned: 0 in 0.327s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Lock "cinder-quobyte-f89ba3e3-6eef-44fd-b159-4d013b336aac" released by "delete_volume" :: held 0.840s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Created reservations ['139206bd-3292-4158-8cbc-c45c8fd9745f', '3a1ced9f-cf96-4cda-97b5-4539e3b7777a', '759a7db7-76f2-4d44-91fc-c9e3bd4f55b7', 'be7cfd49-d12f-4654-8623-b7b6d18d1b0c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:11 devstack sudo[95869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:06:11 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:12 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.530s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:06:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Deleted volume successfully.
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-435daef1-90cb-4df5-b10c-9409dd37e5be tempest-DeleteServersTestJSON-1533405207 None] Lock "cinder-f89ba3e3-6eef-44fd-b159-4d013b336aac-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Flow 'volume_create_manager' (e352ff5a-ca83-4af1-8b1d-1dd28c9a29fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea285e6-e8cc-4298-af8a-74043d355a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea285e6-e8cc-4298-af8a-74043d355a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-43762488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90751eb9d1e746daa7d625e6c76e8d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:12Z,use_quota=True,user_id='d8072a81b2ba4132b3f34d2bed86d0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53398467-59ab-4942-aa9b-c38ddb379e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53398467-59ab-4942-aa9b-c38ddb379e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32dc1699-069e-4b25-8985-ca77613c495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32dc1699-069e-4b25-8985-ca77613c495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7', 'volume_name': 'volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf516b6-75f2-43d0-8738-be18368a9c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf516b6-75f2-43d0-8738-be18368a9c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30935522-c95d-49ff-92cc-fce495bcc100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:12 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Volume 8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7', 'volume_size': 1}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-43762488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90751eb9d1e746daa7d625e6c76e8d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:12Z,use_quota=True,user_id='d8072a81b2ba4132b3f34d2bed86d0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Creating volume 8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:06:12 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:12 devstack sudo[95872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 1073741824
Aug 26 03:06:12 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:12 devstack sudo[95877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:06:12 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:12 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 8 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:06:12 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 1073741824" returned: 0 in 0.649s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:12 devstack sudo[95882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7
Aug 26 03:06:12 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:13 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7" returned: 0 in 0.343s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30935522-c95d-49ff-92cc-fce495bcc100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58316dc-8e05-4b05-970c-f54735025600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Volume volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 (8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7): created successfully
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58316dc-8e05-4b05-970c-f54735025600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Flow 'volume_create_manager' (e352ff5a-ca83-4af1-8b1d-1dd28c9a29fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:06:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4b654a01-ecab-4bd3-b6d1-aa5678a1e0be tempest-VolumesServicesTestJSON-1830100904 None] Created volume successfully.
Aug 26 03:06:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Acquiring lock "cinder-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:06:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Lock "cinder-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:06:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Acquiring lock "cinder-quobyte-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:06:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Lock "cinder-quobyte-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:06:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[562e63af-8b49-46bb-8d3e-1c5a6bf2746f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:06:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:15 devstack sudo[95890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7
Aug 26 03:06:15 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:15 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7" returned: 0 in 0.612s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:15 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7
Aug 26 03:06:15 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:15 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Flow 'volume_create_manager' (3d54d35c-4c2e-429c-9fec-9d0d59468ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0da5d6-7b3a-486b-9b2d-e5bd2f3fa548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7" returned: 0 in 0.478s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0da5d6-7b3a-486b-9b2d-e5bd2f3fa548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1941821155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d062711-0517-4bc0-83ec-ecc4e371ed4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4d6a717f749f38654e6d07817a9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:16Z,use_quota=True,user_id='1ff93c8804044b8399c20455d0fd9976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94b94fc-5bd1-482d-a8de-8caaceac05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94b94fc-5bd1-482d-a8de-8caaceac05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013b34ad-15a0-4878-99ba-745c7221b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013b34ad-15a0-4878-99ba-745c7221b77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d062711-0517-4bc0-83ec-ecc4e371ed4c', 'volume_name': 'volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9868fcb9-d975-4924-80da-70b93d406abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9868fcb9-d975-4924-80da-70b93d406abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f508a89-fda6-49ed-acf3-fb648b5bc74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Volume 1d062711-0517-4bc0-83ec-ecc4e371ed4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c', 'volume_size': 1}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1941821155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d062711-0517-4bc0-83ec-ecc4e371ed4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4d6a717f749f38654e6d07817a9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:16Z,use_quota=True,user_id='1ff93c8804044b8399c20455d0fd9976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Creating volume 1d062711-0517-4bc0-83ec-ecc4e371ed4c {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:06:16 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Lock "cinder-quobyte-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7" released by "delete_volume" :: held 1.223s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:06:16 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c 1073741824
Aug 26 03:06:16 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Created reservations ['15eb2bcd-bbcb-445c-8277-158055ff3801', '165ad3ac-157a-49ed-9bfe-35fb5418b343', 'fa43e417-29db-4434-bda0-22b5a7c83b5e', 'ade27130-d8c5-4893-a08e-80a88bda4658'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:16 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:06:16 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:16 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.354s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:06:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Deleted volume successfully.
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ea78a02b-d370-488c-af94-c3701a58bc10 tempest-VolumesServicesTestJSON-1830100904 None] Lock "cinder-8a1c9f9f-9d74-49da-ad5e-d51aa053d0a7-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:06:16 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c 1073741824" returned: 0 in 0.740s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:06:16 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c
Aug 26 03:06:16 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:06:17 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f508a89-fda6-49ed-acf3-fb648b5bc74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f88fc0d-67b1-4124-921b-5e48ba37b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:06:17 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Volume volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c (1d062711-0517-4bc0-83ec-ecc4e371ed4c): created successfully
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f88fc0d-67b1-4124-921b-5e48ba37b352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:06:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Flow 'volume_create_manager' (3d54d35c-4c2e-429c-9fec-9d0d59468ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:06:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-944312f6-89e7-4854-9964-8bd458badea7 tempest-ServerActionsTestOtherA-1838051355 None] Created volume successfully.
Aug 26 03:06:27 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=47,cinder:INSERT=7,cinder:SELECT=26,cinder:DELETE=2 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:06:27 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=35,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=9 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:07:02 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:07:02 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-0a2a8c3f-f163-4350-a422-1b0af7eb6f3b req-3c3f627d-a96a-4e7f-a2f1-84aed72fc642 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-0a2a8c3f-f163-4350-a422-1b0af7eb6f3b req-3c3f627d-a96a-4e7f-a2f1-84aed72fc642 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-0a2a8c3f-f163-4350-a422-1b0af7eb6f3b req-3c3f627d-a96a-4e7f-a2f1-84aed72fc642 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-0a2a8c3f-f163-4350-a422-1b0af7eb6f3b req-3c3f627d-a96a-4e7f-a2f1-84aed72fc642 tempest-ServerActionsTestOtherA-1838051355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '862a348b-359a-4208-a86e-b60db8185d54', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:07:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-0a2a8c3f-f163-4350-a422-1b0af7eb6f3b req-3c3f627d-a96a-4e7f-a2f1-84aed72fc642 tempest-ServerActionsTestOtherA-1838051355 None] attachment_update completed successfully.
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:12 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:07:12 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:13 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.610s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:07:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-049f501f-6c52-414a-bc1c-1730b1c497a9 tempest-ServerActionsTestOtherA-1838051355 None] Terminate volume connection completed successfully.
Aug 26 03:07:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-049f501f-6c52-414a-bc1c-1730b1c497a9 tempest-ServerActionsTestOtherA-1838051355 None] Deleting attachment 862a348b-359a-4208-a86e-b60db8185d54. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:07:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-c20ec712-badd-4615-bb61-98b01d8587b6 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-c20ec712-badd-4615-bb61-98b01d8587b6 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-c20ec712-badd-4615-bb61-98b01d8587b6 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-c20ec712-badd-4615-bb61-98b01d8587b6 tempest-ServerActionsTestOtherA-1838051355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c1bb3e2-51ff-4d85-b464-2b65ffec3875', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:07:19 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-e6363bb8-440f-4319-bbd7-b3e61a084c9e req-c20ec712-badd-4615-bb61-98b01d8587b6 tempest-ServerActionsTestOtherA-1838051355 None] attachment_update completed successfully.
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Flow 'volume_create_manager' (a02acfa6-a968-4702-8885-e611c0ba1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9994d30a-c626-4afe-927a-14fc03abce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9994d30a-c626-4afe-927a-14fc03abce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1630833326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656468fc-e903-4435-bffe-56dd40d27095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b47b04eca466098be65086f04f779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:27Z,use_quota=True,user_id='b28a63cf1f8842bd896270f6b53f27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09433efc-a104-43bd-90eb-a0630b05c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09433efc-a104-43bd-90eb-a0630b05c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e8ee65-24b8-4f74-8ef7-970af4d7aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e8ee65-24b8-4f74-8ef7-970af4d7aeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656468fc-e903-4435-bffe-56dd40d27095', 'volume_name': 'volume-656468fc-e903-4435-bffe-56dd40d27095', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4bc73a-8167-4764-83f6-aef4203eacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4bc73a-8167-4764-83f6-aef4203eacc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bcaaef9-c203-4f57-95c2-9961303d7a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:27 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Volume 656468fc-e903-4435-bffe-56dd40d27095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656468fc-e903-4435-bffe-56dd40d27095', 'volume_size': 1}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1630833326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656468fc-e903-4435-bffe-56dd40d27095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='561b47b04eca466098be65086f04f779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:27Z,use_quota=True,user_id='b28a63cf1f8842bd896270f6b53f27b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Creating volume 656468fc-e903-4435-bffe-56dd40d27095 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:07:27 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:07:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:27 devstack sudo[97290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095 1073741824
Aug 26 03:07:27 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:28 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095 1073741824" returned: 0 in 1.037s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:28 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095
Aug 26 03:07:28 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:29 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095" returned: 0 in 0.377s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bcaaef9-c203-4f57-95c2-9961303d7a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656468fc-e903-4435-bffe-56dd40d27095', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e64379-0bcd-4bd5-9b9e-6f21019181c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:29 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Volume volume-656468fc-e903-4435-bffe-56dd40d27095 (656468fc-e903-4435-bffe-56dd40d27095): created successfully
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e64379-0bcd-4bd5-9b9e-6f21019181c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Flow 'volume_create_manager' (a02acfa6-a968-4702-8885-e611c0ba1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:07:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-df843760-9e98-482f-a976-3a462b16662c tempest-AttachVolumeShelveTestJSON-1603678382 None] Created volume successfully.
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Flow 'volume_create_manager' (c4f4d2f2-9675-4b71-b2fb-1fc062156870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd41273e-4d36-494f-a6ce-017604481e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd41273e-4d36-494f-a6ce-017604481e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1282533996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c37e0a-719d-45fa-aad8-9bbd12b164ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adba0894ae1a431caf1caf4c823d2ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:32Z,use_quota=True,user_id='d8e207bca399468f9e639c5f1027bdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b81f80e-e4a9-4d50-a193-73c109a6667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b81f80e-e4a9-4d50-a193-73c109a6667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f1ad5d-0f44-4c5d-9d7d-7095295be51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f1ad5d-0f44-4c5d-9d7d-7095295be51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c37e0a-719d-45fa-aad8-9bbd12b164ce', 'volume_name': 'volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2477340-2f6d-43d9-bf5b-34eed38ccc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2477340-2f6d-43d9-bf5b-34eed38ccc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8fc979c-6bd2-4bde-88af-e487e9dbb0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Volume 60c37e0a-719d-45fa-aad8-9bbd12b164ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce', 'volume_size': 1}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1282533996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c37e0a-719d-45fa-aad8-9bbd12b164ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adba0894ae1a431caf1caf4c823d2ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:32Z,use_quota=True,user_id='d8e207bca399468f9e639c5f1027bdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Creating volume 60c37e0a-719d-45fa-aad8-9bbd12b164ce {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:07:32 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:07:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:32 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce 1073741824
Aug 26 03:07:32 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:33 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce 1073741824" returned: 0 in 1.033s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:33 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce
Aug 26 03:07:33 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:33 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce" returned: 0 in 0.637s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8fc979c-6bd2-4bde-88af-e487e9dbb0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af9f378-fa4a-4616-81e3-d9de349014c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Volume volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce (60c37e0a-719d-45fa-aad8-9bbd12b164ce): created successfully
Aug 26 03:07:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af9f378-fa4a-4616-81e3-d9de349014c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Flow 'volume_create_manager' (c4f4d2f2-9675-4b71-b2fb-1fc062156870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:07:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-83da02ec-fbaa-4947-9bb3-e2e539c00759 tempest-VolumesAdminNegativeTest-177541737 None] Created volume successfully.
Aug 26 03:07:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Acquiring lock "cinder-60c37e0a-719d-45fa-aad8-9bbd12b164ce-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:07:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Lock "cinder-60c37e0a-719d-45fa-aad8-9bbd12b164ce-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:07:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Acquiring lock "cinder-quobyte-60c37e0a-719d-45fa-aad8-9bbd12b164ce" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:07:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Lock "cinder-quobyte-60c37e0a-719d-45fa-aad8-9bbd12b164ce" acquired by "delete_volume" :: waited 0.051s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:07:36 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[43544fe5-f0f9-45ce-bdce-e90a0b0a8f06]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:07:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:36 devstack sudo[97370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce
Aug 26 03:07:36 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:37 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce" returned: 0 in 0.737s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:37 devstack sudo[97375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce
Aug 26 03:07:37 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:38 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60c37e0a-719d-45fa-aad8-9bbd12b164ce" returned: 0 in 0.789s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Lock "cinder-quobyte-60c37e0a-719d-45fa-aad8-9bbd12b164ce" released by "delete_volume" :: held 1.666s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Created reservations ['a1e14bfe-e51e-4f7d-bc8d-c04e1db7dfe0', '1c3091ca-7186-41bc-af87-f7df228664b9', 'a46428ba-c1a8-4799-94ad-3f16bbb4d58b', '89c7aacf-edfe-4118-91ec-dc3fff14aac3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:38 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:07:38 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:38 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.399s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:07:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Deleted volume successfully.
Aug 26 03:07:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68b79eff-0086-45ce-99cb-d118d10c0595 tempest-VolumesAdminNegativeTest-177541737 None] Lock "cinder-60c37e0a-719d-45fa-aad8-9bbd12b164ce-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:07:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-961af34b-e801-4ff4-84b4-c3d83e2e07a9 req-9dbc3168-acbf-4fe5-95f0-741a451821ca tempest-AttachVolumeShelveTestJSON-1603678382 None] No connector for attachment ab50d37e-a530-443b-bdc9-d61b7cb41907; skipping storage backend terminate_connection call. {{(pid=94326) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Aug 26 03:07:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-961af34b-e801-4ff4-84b4-c3d83e2e07a9 req-9dbc3168-acbf-4fe5-95f0-741a451821ca tempest-AttachVolumeShelveTestJSON-1603678382 None] Deleting attachment ab50d37e-a530-443b-bdc9-d61b7cb41907. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:07:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-2541b46d-1770-400a-80bf-149d47f194b1 req-f973aeb9-02ad-4193-b019-d1096d56e4d2 tempest-ServerActionsTestOtherA-1838051355 None] Terminate volume connection completed successfully.
Aug 26 03:07:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-2541b46d-1770-400a-80bf-149d47f194b1 req-f973aeb9-02ad-4193-b019-d1096d56e4d2 tempest-ServerActionsTestOtherA-1838051355 None] Deleting attachment 1c1bb3e2-51ff-4d85-b464-2b65ffec3875. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:07:57 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=24,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:07:58 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:07:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (6fefe442-5864-4739-8f87-165708f4295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:07:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c985bc-6f16-4255-b340-598fc7cd6b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c985bc-6f16-4255-b340-598fc7cd6b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061824364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5218233d-d94e-40a1-81e6-4b73d49b0c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:59Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17caa84e-673a-4f66-9245-9e744d9fd92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17caa84e-673a-4f66-9245-9e744d9fd92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d219c92-59fe-43cc-a04a-f0ab1d10be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d219c92-59fe-43cc-a04a-f0ab1d10be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5218233d-d94e-40a1-81e6-4b73d49b0c20', 'volume_name': 'volume-5218233d-d94e-40a1-81e6-4b73d49b0c20', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05933e-1bbd-434d-b4bf-c9e989cd69c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05933e-1bbd-434d-b4bf-c9e989cd69c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ca9c2d-1754-4fc5-87a4-d317738417e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:07:59 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Volume 5218233d-d94e-40a1-81e6-4b73d49b0c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5218233d-d94e-40a1-81e6-4b73d49b0c20', 'volume_size': 1}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061824364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5218233d-d94e-40a1-81e6-4b73d49b0c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:59Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Creating volume 5218233d-d94e-40a1-81e6-4b73d49b0c20 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:07:59 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:07:59 devstack sudo[97692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 1073741824
Aug 26 03:07:59 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:07:59 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root
Aug 26 03:07:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 1073741824" returned: 0 in 0.829s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:00 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20
Aug 26 03:08:00 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:00 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20" returned: 0 in 0.669s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ca9c2d-1754-4fc5-87a4-d317738417e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5218233d-d94e-40a1-81e6-4b73d49b0c20', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593037eb-f6ba-4e92-9a9d-6852805ce0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Volume volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 (5218233d-d94e-40a1-81e6-4b73d49b0c20): created successfully
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593037eb-f6ba-4e92-9a9d-6852805ce0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (6fefe442-5864-4739-8f87-165708f4295d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f4a40aad-aeb6-499d-a299-60768c2fcdeb tempest-VolumesActionsTest-215565345 None] Created volume successfully.
Aug 26 03:08:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bce3669d-2e1c-42c9-b5a0-916a54825eba tempest-VolumesActionsTest-215565345 None] Acquiring lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20" by "attach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bce3669d-2e1c-42c9-b5a0-916a54825eba tempest-VolumesActionsTest-215565345 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20" acquired by "attach_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bce3669d-2e1c-42c9-b5a0-916a54825eba tempest-VolumesActionsTest-215565345 None] Attaching volume 5218233d-d94e-40a1-81e6-4b73d49b0c20 to instance efee4833-0b7a-4ed4-a9ef-6d1bb487a7d8 at mountpoint /dev/vdb on host None.
Aug 26 03:08:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bce3669d-2e1c-42c9-b5a0-916a54825eba tempest-VolumesActionsTest-215565345 None] Attach volume completed successfully.
Aug 26 03:08:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bce3669d-2e1c-42c9-b5a0-916a54825eba tempest-VolumesActionsTest-215565345 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20" released by "attach_volume" :: held 0.187s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-363bc234-d923-4cfa-a217-308aab3339a8 tempest-VolumesActionsTest-1977116071 None] Terminate volume connection completed successfully.
Aug 26 03:08:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-363bc234-d923-4cfa-a217-308aab3339a8 tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-detach_volume" by "detach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-363bc234-d923-4cfa-a217-308aab3339a8 tempest-VolumesActionsTest-1977116071 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-363bc234-d923-4cfa-a217-308aab3339a8 tempest-VolumesActionsTest-1977116071 None] Detaching volume 5218233d-d94e-40a1-81e6-4b73d49b0c20 from instance efee4833-0b7a-4ed4-a9ef-6d1bb487a7d8.
Aug 26 03:08:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-363bc234-d923-4cfa-a217-308aab3339a8 tempest-VolumesActionsTest-1977116071 None] Detach volume completed successfully.
Aug 26 03:08:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-363bc234-d923-4cfa-a217-308aab3339a8 tempest-VolumesActionsTest-1977116071 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-92f08a3b-4bbe-44a7-8291-d8d0d32595cd tempest-VolumesActionsTest-215565345 None] Acquiring lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-detach_volume" by "detach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-92f08a3b-4bbe-44a7-8291-d8d0d32595cd tempest-VolumesActionsTest-215565345 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-92f08a3b-4bbe-44a7-8291-d8d0d32595cd tempest-VolumesActionsTest-215565345 None] Volume detach called, but volume not attached.
Aug 26 03:08:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-92f08a3b-4bbe-44a7-8291-d8d0d32595cd tempest-VolumesActionsTest-215565345 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Acquiring lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=3 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Acquiring lock "cinder-quobyte-5218233d-d94e-40a1-81e6-4b73d49b0c20" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Lock "cinder-quobyte-5218233d-d94e-40a1-81e6-4b73d49b0c20" acquired by "delete_volume" :: waited 0.060s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[04685e22-a880-45e9-8d9f-abc7616e270d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:03 devstack sudo[97719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20
Aug 26 03:08:03 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:04 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20" returned: 0 in 0.785s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:04 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20
Aug 26 03:08:04 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:04 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5218233d-d94e-40a1-81e6-4b73d49b0c20" returned: 0 in 0.476s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Lock "cinder-quobyte-5218233d-d94e-40a1-81e6-4b73d49b0c20" released by "delete_volume" :: held 1.321s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Created reservations ['e0744bf6-3f0c-4707-99a6-cb36264af688', 'e6893abc-c1a9-46ba-9d83-2784e64a1258', '9e9c766d-f8bc-4b55-88dc-c639a7d74ea8', 'c085365e-fea7-4764-b22f-9d4eedd3cf2d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:04 devstack sudo[97752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:04 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:05 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.535s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:05 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Deleted volume successfully.
Aug 26 03:08:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-bacfe4e2-e686-457f-b3d1-bdbdc5d50b1a tempest-VolumesActionsTest-215565345 None] Lock "cinder-5218233d-d94e-40a1-81e6-4b73d49b0c20-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Flow 'volume_create_manager' (922acf15-fea8-427b-84df-2e76bba0c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130f812d-44c1-44dd-81cc-7462a7aaae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130f812d-44c1-44dd-81cc-7462a7aaae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1160850191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2106fb91-95b9-48ac-941a-5cf34b925a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4d6a717f749f38654e6d07817a9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:07Z,use_quota=True,user_id='1ff93c8804044b8399c20455d0fd9976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2de57ca-87a2-4387-be8d-919710744d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2de57ca-87a2-4387-be8d-919710744d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7913d423-9282-4e80-af11-544f79a4719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:06 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:08:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7913d423-9282-4e80-af11-544f79a4719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2106fb91-95b9-48ac-941a-5cf34b925a23', 'volume_name': 'volume-2106fb91-95b9-48ac-941a-5cf34b925a23', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb194680>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd0d6b4-b2da-482f-bc22-374629382ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd0d6b4-b2da-482f-bc22-374629382ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce234caf-e495-404a-91be-e346aefc79ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:07 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Volume 2106fb91-95b9-48ac-941a-5cf34b925a23: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2106fb91-95b9-48ac-941a-5cf34b925a23', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb194680>}
Aug 26 03:08:07 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Trying to clone 2106fb91-95b9-48ac-941a-5cf34b925a23 from image fbacabb5-c169-4db6-835c-c8c852a95048 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:08:08 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:08:08 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 03:08:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc275542-9b4c-4437-a9ae-c956b77312de]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:08 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD
Aug 26 03:08:08 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:09 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 is fetched for user 1ff93c8804044b8399c20455d0fd9976. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b303a22e-cd9c-4432-9e2b-4eb4665330dc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:09 devstack sudo[97889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD
Aug 26 03:08:09 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:09 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1160850191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2106fb91-95b9-48ac-941a-5cf34b925a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4d6a717f749f38654e6d07817a9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:07Z,use_quota=True,user_id='1ff93c8804044b8399c20455d0fd9976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Creating volume 2106fb91-95b9-48ac-941a-5cf34b925a23 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:09 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:10 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 1073741824
Aug 26 03:08:10 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (a0ea7703-46e5-4020-af35-48577dd59a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940c9ec9-7d9c-4af0-b41e-33c2c955b2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940c9ec9-7d9c-4af0-b41e-33c2c955b2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1560561863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3c3993-3a70-46c5-9723-5e7d7f9ba93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:11Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:10 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634a1ac7-ddf5-418f-88b7-4da74cbc35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634a1ac7-ddf5-418f-88b7-4da74cbc35cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c3878f-700d-4f54-a2e5-c167e2b3a654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c3878f-700d-4f54-a2e5-c167e2b3a654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3c3993-3a70-46c5-9723-5e7d7f9ba93d', 'volume_name': 'volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae256c3d-4bd0-4d8b-bca8-4e27e42e0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae256c3d-4bd0-4d8b-bca8-4e27e42e0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe58e27-e4f2-4c8b-9664-76baa922c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Volume 6d3c3993-3a70-46c5-9723-5e7d7f9ba93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d', 'volume_size': 1}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 1073741824" returned: 0 in 0.985s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:11 devstack sudo[97906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23
Aug 26 03:08:11 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:11 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23" returned: 0 in 0.589s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1560561863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3c3993-3a70-46c5-9723-5e7d7f9ba93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:11Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Creating volume 6d3c3993-3a70-46c5-9723-5e7d7f9ba93d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:11 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:11 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d 1073741824
Aug 26 03:08:11 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Attempting download of fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 2106fb91-95b9-48ac-941a-5cf34b925a23. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96ed9a-96ad-41c8-82e6-61e33606216d]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:11 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c
Aug 26 03:08:11 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:12 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c" returned: 0 in 0.451s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:12 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d 1073741824" returned: 0 in 0.685s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:12 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c
Aug 26 03:08:12 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:12 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d
Aug 26 03:08:12 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:12 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:12 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:12 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c" returned: 1 in 0.705s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_aev2kl3c' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c9836-cb5c-4b30-9345-7c4c1c4b8716]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:12 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:12 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d" returned: 0 in 0.601s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.424s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe58e27-e4f2-4c8b-9664-76baa922c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1462f10-d5fe-4133-9f40-4839778cd681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Volume volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d (6d3c3993-3a70-46c5-9723-5e7d7f9ba93d): created successfully
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1462f10-d5fe-4133-9f40-4839778cd681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (a0ea7703-46e5-4020-af35-48577dd59a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:13 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD
Aug 26 03:08:13 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0743b0e4-49e8-4a0e-8c72-c027b4d2aa29 tempest-VolumesActionsTest-215565345 None] Created volume successfully.
Aug 26 03:08:13 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] fbacabb5-c169-4db6-835c-c8c852a95048 was qcow2, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:08:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:13 devstack sudo[97936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23
Aug 26 03:08:13 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Lock "cinder-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-quobyte-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd2c03-6fd2-4ff4-8549-b5414e566ada]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:14 devstack sudo[97945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d
Aug 26 03:08:14 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:14 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d" returned: 0 in 0.454s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:14 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d
Aug 26 03:08:14 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:15 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d" returned: 0 in 0.324s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d" released by "delete_volume" :: held 0.833s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Created reservations ['34c58598-b5d4-46cf-9a6b-211a2304498f', '89ae4698-d6b7-4797-90ac-289ed3ddc9e1', '1040d824-e7c4-4cfa-9f68-a1274840c64e', 'fdf10605-66b4-4a5f-81a6-dda59b7a606b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:15 devstack sudo[97955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:15 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:15 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.516s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Deleted volume successfully.
Aug 26 03:08:15 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23" returned: 0 in 2.408s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_ykw288sodevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:08:15 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Converted 112.00 MB image at 46.48 MB/s
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-07562fbc-1c61-41ff-b46c-c1e744f390eb tempest-VolumesActionsTest-1977116071 None] Lock "cinder-6d3c3993-3a70-46c5-9723-5e7d7f9ba93d-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:15 devstack sudo[97958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 1G
Aug 26 03:08:15 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (c406669c-ed50-471e-9266-458aeacd3136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec4468e-55c6-411d-b740-d05e2b5439ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec4468e-55c6-411d-b740-d05e2b5439ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1815787382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4178a9b3-1c6f-4231-897b-ccd45b515b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:16Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94364e71-9a81-4f7f-863d-9c17058a5653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94364e71-9a81-4f7f-863d-9c17058a5653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462083f5-5e5f-404b-bf0c-afbcb35f0b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462083f5-5e5f-404b-bf0c-afbcb35f0b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4178a9b3-1c6f-4231-897b-ccd45b515b95', 'volume_name': 'volume-4178a9b3-1c6f-4231-897b-ccd45b515b95', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb790670-f6bc-4129-8310-a7c029d71e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb790670-f6bc-4129-8310-a7c029d71e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3be5e4-4cd1-436f-a52f-c6b5f575429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Volume 4178a9b3-1c6f-4231-897b-ccd45b515b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4178a9b3-1c6f-4231-897b-ccd45b515b95', 'volume_size': 1}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1815787382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4178a9b3-1c6f-4231-897b-ccd45b515b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:16Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Creating volume 4178a9b3-1c6f-4231-897b-ccd45b515b95 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:16 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:16 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 1G" returned: 0 in 0.505s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Downloaded image fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 2106fb91-95b9-48ac-941a-5cf34b925a23 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 for user 1ff93c8804044b8399c20455d0fd9976 is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Marking volume 2106fb91-95b9-48ac-941a-5cf34b925a23 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:08:16 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 1073741824
Aug 26 03:08:16 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Copying metadata from image fbacabb5-c169-4db6-835c-c8c852a95048 to 2106fb91-95b9-48ac-941a-5cf34b925a23. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Creating volume glance metadata for volume 2106fb91-95b9-48ac-941a-5cf34b925a23 backed by image fbacabb5-c169-4db6-835c-c8c852a95048 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce234caf-e495-404a-91be-e346aefc79ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2106fb91-95b9-48ac-941a-5cf34b925a23', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb194680>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541407dd-42d8-4813-b3cb-7f8428aad552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Volume volume-2106fb91-95b9-48ac-941a-5cf34b925a23 (2106fb91-95b9-48ac-941a-5cf34b925a23): created successfully
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541407dd-42d8-4813-b3cb-7f8428aad552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Flow 'volume_create_manager' (922acf15-fea8-427b-84df-2e76bba0c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f61d2f00-68b9-4de9-827d-8ecab08aee79 tempest-ServerActionsTestOtherA-1838051355 None] Created volume successfully.
Aug 26 03:08:17 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 1073741824" returned: 0 in 0.722s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:17 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95
Aug 26 03:08:17 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:17 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95" returned: 0 in 0.402s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3be5e4-4cd1-436f-a52f-c6b5f575429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4178a9b3-1c6f-4231-897b-ccd45b515b95', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db3801c-616c-4ef0-9d7f-ba69f8ff9c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:17 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Volume volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 (4178a9b3-1c6f-4231-897b-ccd45b515b95): created successfully
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db3801c-616c-4ef0-9d7f-ba69f8ff9c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (c406669c-ed50-471e-9266-458aeacd3136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d1dda773-36a2-46fc-970e-03e4bd3a35d2 tempest-VolumesActionsTest-215565345 None] Created volume successfully.
Aug 26 03:08:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-4178a9b3-1c6f-4231-897b-ccd45b515b95-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Lock "cinder-4178a9b3-1c6f-4231-897b-ccd45b515b95-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-quobyte-4178a9b3-1c6f-4231-897b-ccd45b515b95" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-4178a9b3-1c6f-4231-897b-ccd45b515b95" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8666612-8274-454a-bb79-8ebae1ab678a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:18 devstack sudo[97977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95
Aug 26 03:08:18 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:19 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95" returned: 0 in 0.581s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:19 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95
Aug 26 03:08:19 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:19 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4178a9b3-1c6f-4231-897b-ccd45b515b95" returned: 0 in 0.455s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-4178a9b3-1c6f-4231-897b-ccd45b515b95" released by "delete_volume" :: held 1.118s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Created reservations ['5fba6cac-fecf-4679-8b10-b258447edf8f', '568b7828-2744-4db5-979c-b5edacee51b0', '293c9550-3510-45f3-ab64-49f6fb90e17d', '6c1e2dea-2790-4007-a419-4e0c5cbf8681'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:19 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:19 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:20 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.418s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Deleted volume successfully.
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b15e8215-0545-4aa6-8354-f4e9a11699cf req-37d67c80-285a-4fd9-a75d-8eddb1e135d9 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b15e8215-0545-4aa6-8354-f4e9a11699cf req-37d67c80-285a-4fd9-a75d-8eddb1e135d9 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b15e8215-0545-4aa6-8354-f4e9a11699cf req-37d67c80-285a-4fd9-a75d-8eddb1e135d9 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-25ab551f-dbe6-4010-a5c3-ba1ac8ed254d tempest-VolumesActionsTest-1977116071 None] Lock "cinder-4178a9b3-1c6f-4231-897b-ccd45b515b95-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-b15e8215-0545-4aa6-8354-f4e9a11699cf req-37d67c80-285a-4fd9-a75d-8eddb1e135d9 tempest-ServerActionsTestOtherA-1838051355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-2106fb91-95b9-48ac-941a-5cf34b925a23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37053ac6-79b2-4a9e-b61d-5f268f1953f3', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:08:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-b15e8215-0545-4aa6-8354-f4e9a11699cf req-37d67c80-285a-4fd9-a75d-8eddb1e135d9 tempest-ServerActionsTestOtherA-1838051355 None] attachment_update completed successfully.
Aug 26 03:08:21 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (b7d18327-bec5-4dd5-a297-ee61e2a6912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c696bb6-3613-4adb-b0ed-7ce4d6a92705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c696bb6-3613-4adb-b0ed-7ce4d6a92705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2067151282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36188e4f-bea2-4462-a977-0e54ac841273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:22Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbf0432-8c7e-45b3-8ed1-f56ff1b3ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbf0432-8c7e-45b3-8ed1-f56ff1b3ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddd7b03-ed10-4975-9fe7-e885a2dc7d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddd7b03-ed10-4975-9fe7-e885a2dc7d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36188e4f-bea2-4462-a977-0e54ac841273', 'volume_name': 'volume-36188e4f-bea2-4462-a977-0e54ac841273', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b29819-f994-41b7-860c-c3e6944ce9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b29819-f994-41b7-860c-c3e6944ce9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99762fa-9738-43b0-a7c2-4e9ff73b1c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:22 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Volume 36188e4f-bea2-4462-a977-0e54ac841273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36188e4f-bea2-4462-a977-0e54ac841273', 'volume_size': 1}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2067151282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36188e4f-bea2-4462-a977-0e54ac841273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:22Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Creating volume 36188e4f-bea2-4462-a977-0e54ac841273 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:22 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:22 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273 1073741824
Aug 26 03:08:22 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:22 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273 1073741824" returned: 0 in 0.560s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:22 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273
Aug 26 03:08:22 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:23 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273" returned: 0 in 0.412s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99762fa-9738-43b0-a7c2-4e9ff73b1c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36188e4f-bea2-4462-a977-0e54ac841273', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9175d906-9fd8-47aa-a7f3-21d89c62383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:23 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Volume volume-36188e4f-bea2-4462-a977-0e54ac841273 (36188e4f-bea2-4462-a977-0e54ac841273): created successfully
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9175d906-9fd8-47aa-a7f3-21d89c62383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:23 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (b7d18327-bec5-4dd5-a297-ee61e2a6912b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f0163ee4-5dc9-4205-a51f-e5c7e153817c tempest-VolumesActionsTest-215565345 None] Created volume successfully.
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-36188e4f-bea2-4462-a977-0e54ac841273-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Lock "cinder-36188e4f-bea2-4462-a977-0e54ac841273-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-quobyte-36188e4f-bea2-4462-a977-0e54ac841273" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-36188e4f-bea2-4462-a977-0e54ac841273" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c505a2a9-4270-4b5e-b31f-00fc199406c0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:24 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273
Aug 26 03:08:24 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:24 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273" returned: 0 in 0.745s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:25 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273
Aug 26 03:08:25 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:25 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-36188e4f-bea2-4462-a977-0e54ac841273" returned: 0 in 0.366s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-36188e4f-bea2-4462-a977-0e54ac841273" released by "delete_volume" :: held 1.172s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Created reservations ['7ce2df54-a11e-4b63-94d3-91d0a04896f6', '68e7a2b7-5294-47fe-b3b0-97ed0e491509', 'f9fb2bb6-0a39-4748-83c4-575fc9bc6393', 'c63fdfef-113b-4a6c-aeb2-d24ec39745be'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:25 devstack sudo[98437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:25 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:25 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.353s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:25 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Deleted volume successfully.
Aug 26 03:08:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-db5fb025-8b03-4842-b8f9-c5c8a6efa2bf tempest-VolumesActionsTest-1977116071 None] Lock "cinder-36188e4f-bea2-4462-a977-0e54ac841273-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (b0eb0930-7b4a-46e5-af6d-51887fde49d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8f63f5-8257-43f7-afe4-895981108bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8f63f5-8257-43f7-afe4-895981108bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2035631925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfb44ec-69ee-41b3-adca-31dc62442c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:27Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63db46c7-49c4-4c8f-ba32-b4f4fe77e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63db46c7-49c4-4c8f-ba32-b4f4fe77e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164ab8c0-ca33-4a5d-85f3-fccb06a7aa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164ab8c0-ca33-4a5d-85f3-fccb06a7aa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfb44ec-69ee-41b3-adca-31dc62442c46', 'volume_name': 'volume-ccfb44ec-69ee-41b3-adca-31dc62442c46', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ef9595-9e14-4f5b-acea-3f996701848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ef9595-9e14-4f5b-acea-3f996701848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f977ed-48f4-42b9-8816-e37f168571f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:27 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Volume ccfb44ec-69ee-41b3-adca-31dc62442c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfb44ec-69ee-41b3-adca-31dc62442c46', 'volume_size': 1}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2035631925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfb44ec-69ee-41b3-adca-31dc62442c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:27Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Creating volume ccfb44ec-69ee-41b3-adca-31dc62442c46 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:27 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:27 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 1073741824
Aug 26 03:08:27 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:27 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 1073741824" returned: 0 in 0.716s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:27 devstack sudo[98469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46
Aug 26 03:08:27 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:28 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f977ed-48f4-42b9-8816-e37f168571f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfb44ec-69ee-41b3-adca-31dc62442c46', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae76b77-2200-46b3-b734-f9f962086845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Volume volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 (ccfb44ec-69ee-41b3-adca-31dc62442c46): created successfully
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae76b77-2200-46b3-b734-f9f962086845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (b0eb0930-7b4a-46e5-af6d-51887fde49d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0eb9f8f9-8cc2-47df-86d0-2a390c304f2d tempest-VolumesActionsTest-215565345 None] Created volume successfully.
Aug 26 03:08:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-ccfb44ec-69ee-41b3-adca-31dc62442c46-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Lock "cinder-ccfb44ec-69ee-41b3-adca-31dc62442c46-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Acquiring lock "cinder-quobyte-ccfb44ec-69ee-41b3-adca-31dc62442c46" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-ccfb44ec-69ee-41b3-adca-31dc62442c46" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:29 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559f17a-7573-411e-bd6c-98f799de5272]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:29 devstack sudo[98473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46
Aug 26 03:08:29 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:30 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46" returned: 0 in 0.668s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:30 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46
Aug 26 03:08:30 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:31 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfb44ec-69ee-41b3-adca-31dc62442c46" returned: 0 in 0.640s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Lock "cinder-quobyte-ccfb44ec-69ee-41b3-adca-31dc62442c46" released by "delete_volume" :: held 1.382s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Created reservations ['35944920-7103-4106-b2c6-1760029e6dd6', '119ba762-a97d-4389-9513-74299d6227f0', '32017c57-c30c-4146-b190-29030fd16f3a', '2b5f77e0-78c6-44bb-9946-c8bb57ceaa84'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:31 devstack sudo[98483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:31 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:31 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.430s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:31 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Deleted volume successfully.
Aug 26 03:08:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34519d87-8456-4510-8b69-9ce7ed49ca9f tempest-VolumesActionsTest-1977116071 None] Lock "cinder-ccfb44ec-69ee-41b3-adca-31dc62442c46-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (d17a35db-4309-4d10-9fe5-6439159f35e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60639f58-08be-4833-8154-43ed6d1a6da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60639f58-08be-4833-8154-43ed6d1a6da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-784307768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a3e1d4-ba94-4531-946f-d926e66beb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:33Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292eaf4-28ba-4467-a036-beb8c4f3a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292eaf4-28ba-4467-a036-beb8c4f3a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be1ccbc-202d-4f3c-a8b9-2fc39dbe6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be1ccbc-202d-4f3c-a8b9-2fc39dbe6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a3e1d4-ba94-4531-946f-d926e66beb77', 'volume_name': 'volume-e8a3e1d4-ba94-4531-946f-d926e66beb77', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772e295c-05d7-4887-9cb4-ba9f0307797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772e295c-05d7-4887-9cb4-ba9f0307797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5802fca-2f1e-4c22-b059-6ddf07224f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Volume e8a3e1d4-ba94-4531-946f-d926e66beb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a3e1d4-ba94-4531-946f-d926e66beb77', 'volume_size': 1}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-784307768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a3e1d4-ba94-4531-946f-d926e66beb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998caeb04d7c48f48199d3bc74f8f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:33Z,use_quota=True,user_id='c86df55d394a4780ba7e07b4f0d61a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Creating volume e8a3e1d4-ba94-4531-946f-d926e66beb77 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:33 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:33 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 1073741824
Aug 26 03:08:33 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:34 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 1073741824" returned: 0 in 1.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:34 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77
Aug 26 03:08:34 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:35 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77" returned: 0 in 0.623s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5802fca-2f1e-4c22-b059-6ddf07224f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a3e1d4-ba94-4531-946f-d926e66beb77', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa66e28-3a61-4ab7-a078-7ff35f6cec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:35 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Volume volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 (e8a3e1d4-ba94-4531-946f-d926e66beb77): created successfully
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa66e28-3a61-4ab7-a078-7ff35f6cec7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Flow 'volume_create_manager' (d17a35db-4309-4d10-9fe5-6439159f35e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-504d1519-7320-4beb-b695-74dc0ecb5864 tempest-VolumesActionsTest-215565345 None] Created volume successfully.
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Acquiring lock "cinder-e8a3e1d4-ba94-4531-946f-d926e66beb77-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Lock "cinder-e8a3e1d4-ba94-4531-946f-d926e66beb77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Acquiring lock "cinder-quobyte-e8a3e1d4-ba94-4531-946f-d926e66beb77" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Lock "cinder-quobyte-e8a3e1d4-ba94-4531-946f-d926e66beb77" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14df926-4a9b-4c0e-9efb-d11377a3ba7a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:38 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77
Aug 26 03:08:38 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:38 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77" returned: 0 in 0.608s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:38 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77
Aug 26 03:08:38 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:39 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e8a3e1d4-ba94-4531-946f-d926e66beb77" returned: 0 in 0.444s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Lock "cinder-quobyte-e8a3e1d4-ba94-4531-946f-d926e66beb77" released by "delete_volume" :: held 1.129s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Created reservations ['468ca031-4cc5-49db-be2a-9b5fcd8d7377', '55ddf912-62c2-47c8-b1f3-c361063b01e8', 'd7d98ca8-ca50-4482-a3a4-b3d8a47533c1', 'bdef5368-b391-43b3-b469-a51feb9e010c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:39 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:39 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:40 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.324s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:40 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Deleted volume successfully.
Aug 26 03:08:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dc65cb03-f9fb-4fcd-bcad-8ef5bd4a4652 tempest-VolumesActionsTest-215565345 None] Lock "cinder-e8a3e1d4-ba94-4531-946f-d926e66beb77-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-fa3f86c1-b774-4757-b8d3-1c1a9f52bfe5 tempest-ServerActionsTestOtherA-1838051355 None] Terminate volume connection completed successfully.
Aug 26 03:08:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-fa3f86c1-b774-4757-b8d3-1c1a9f52bfe5 tempest-ServerActionsTestOtherA-1838051355 None] Deleting attachment 37053ac6-79b2-4a9e-b61d-5f268f1953f3. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:08:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Acquiring lock "cinder-656468fc-e903-4435-bffe-56dd40d27095-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "cinder-656468fc-e903-4435-bffe-56dd40d27095-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Acquiring lock "cinder-quobyte-656468fc-e903-4435-bffe-56dd40d27095" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:08:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "cinder-quobyte-656468fc-e903-4435-bffe-56dd40d27095" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:08:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da9d612-fbbe-47a9-ac63-53f55adeae55]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:08:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:46 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095
Aug 26 03:08:46 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:46 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095" returned: 0 in 0.504s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:46 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095
Aug 26 03:08:46 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:46 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-656468fc-e903-4435-bffe-56dd40d27095" returned: 0 in 0.349s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "cinder-quobyte-656468fc-e903-4435-bffe-56dd40d27095" released by "delete_volume" :: held 0.926s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:46 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Created reservations ['b1d4f5cc-017f-4576-bf56-dd9ba29fd23f', '58cabce7-9029-4413-8187-2d376704ee8b', '5c18e068-1237-41d5-8a32-6dce5029264f', 'ac7bbf02-1565-4946-a676-c73471294cef'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:47 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:08:47 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:47 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:08:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Deleted volume successfully.
Aug 26 03:08:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fbc1e9d5-5d97-4c2d-b55f-1a60ec0c858a tempest-AttachVolumeShelveTestJSON-1603678382 None] Lock "cinder-656468fc-e903-4435-bffe-56dd40d27095-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Flow 'volume_create_manager' (05a1ed5a-45ec-409b-be4d-687503b44b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152fe40f-3c0e-4b34-9a56-d49214b13d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152fe40f-3c0e-4b34-9a56-d49214b13d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-446316314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d7a68d-26b9-48d8-a745-95485618e07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15176ef0d0a24e4d96801c23a7faa277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:51Z,use_quota=True,user_id='6cc7a4e1f28c48dcbe100c705bad1bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fdcc1c-7306-47ed-84d6-0891877dfd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fdcc1c-7306-47ed-84d6-0891877dfd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1c60da-1791-4303-8fab-ca435a23f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1c60da-1791-4303-8fab-ca435a23f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d7a68d-26b9-48d8-a745-95485618e07b', 'volume_name': 'volume-87d7a68d-26b9-48d8-a745-95485618e07b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07643ec-c800-41f5-acfd-62db63d52079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07643ec-c800-41f5-acfd-62db63d52079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19a1da7-bd40-4b12-b0c7-d3c6a2eabc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:51 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Volume 87d7a68d-26b9-48d8-a745-95485618e07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d7a68d-26b9-48d8-a745-95485618e07b', 'volume_size': 1}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-446316314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d7a68d-26b9-48d8-a745-95485618e07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15176ef0d0a24e4d96801c23a7faa277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:51Z,use_quota=True,user_id='6cc7a4e1f28c48dcbe100c705bad1bb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Creating volume 87d7a68d-26b9-48d8-a745-95485618e07b {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:08:51 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:08:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:51 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b 1073741824
Aug 26 03:08:51 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:52 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b 1073741824" returned: 0 in 0.591s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:08:52 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b
Aug 26 03:08:52 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:08:52 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b" returned: 0 in 0.298s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19a1da7-bd40-4b12-b0c7-d3c6a2eabc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d7a68d-26b9-48d8-a745-95485618e07b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831c6cc0-41e5-4cb4-bc15-314e3f49f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:08:52 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Volume volume-87d7a68d-26b9-48d8-a745-95485618e07b (87d7a68d-26b9-48d8-a745-95485618e07b): created successfully
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831c6cc0-41e5-4cb4-bc15-314e3f49f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:08:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Flow 'volume_create_manager' (05a1ed5a-45ec-409b-be4d-687503b44b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:08:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7d7aacdc-4830-4dfd-b591-ca2463d26962 tempest-TaggedAttachmentsTest-568189047 None] Created volume successfully.
Aug 26 03:08:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-c13b2ab4-0a92-491a-b67e-4a07e7b1e587 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:08:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-c13b2ab4-0a92-491a-b67e-4a07e7b1e587 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:08:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-c13b2ab4-0a92-491a-b67e-4a07e7b1e587 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:08:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-c13b2ab4-0a92-491a-b67e-4a07e7b1e587 tempest-ServerActionsTestOtherA-1838051355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-2106fb91-95b9-48ac-941a-5cf34b925a23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49a7ea75-6344-45df-b134-f8f167048e1f', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:08:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-e0d2f2d7-a778-4f0a-8277-587d9fed3e16 req-c13b2ab4-0a92-491a-b67e-4a07e7b1e587 tempest-ServerActionsTestOtherA-1838051355 None] attachment_update completed successfully.
Aug 26 03:09:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=78,cinder:UPDATE=94,cinder:INSERT=25,cinder:DELETE=7 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:09:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=74,cinder:INSERT=25,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Flow 'volume_create_manager' (ab2f8595-28e3-49ca-8817-30941ae600b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b7c3aa-949a-42c6-b989-30eff09dcc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b7c3aa-949a-42c6-b989-30eff09dcc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1760727792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2780c1ac-250a-4403-a38a-cdd65d0df5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4bfd6f4c2247d48bdf9c9c34ed6425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:08Z,use_quota=True,user_id='f646d4c8c23246448fe73970c060a2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db194646-78ce-4ca9-9188-3d1a2d1fe1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db194646-78ce-4ca9-9188-3d1a2d1fe1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c194244c-811f-4d74-b751-13cd9a8a8ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:07 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:09:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c194244c-811f-4d74-b751-13cd9a8a8ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2780c1ac-250a-4403-a38a-cdd65d0df5c1', 'volume_name': 'volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb120170>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1cb5c3-020b-49ae-bd48-2c0f3f73312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1cb5c3-020b-49ae-bd48-2c0f3f73312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c63497b-8e06-409c-8b6f-ebff05683771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Volume 2780c1ac-250a-4403-a38a-cdd65d0df5c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb120170>}
Aug 26 03:09:08 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Trying to clone 2780c1ac-250a-4403-a38a-cdd65d0df5c1 from image fbacabb5-c169-4db6-835c-c8c852a95048 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:09:09 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD, size 20.69 MB, duration 1.01 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:09:09 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Image download 20.69 MB at 20.52 MB/s
Aug 26 03:09:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[197a7dd2-7ed4-49c1-97bb-86b6b434cdc0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:09 devstack sudo[99208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD
Aug 26 03:09:09 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:10 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD" returned: 0 in 0.633s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 is fetched for user f646d4c8c23246448fe73970c060a2b2. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91255bc-7ec0-46db-9d9e-0ee8ca657a19]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:10 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD
Aug 26 03:09:10 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:10 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1760727792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2780c1ac-250a-4403-a38a-cdd65d0df5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4bfd6f4c2247d48bdf9c9c34ed6425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:08Z,use_quota=True,user_id='f646d4c8c23246448fe73970c060a2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Creating volume 2780c1ac-250a-4403-a38a-cdd65d0df5c1 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:09:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:09:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:10 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 1073741824
Aug 26 03:09:10 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:11 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 1073741824" returned: 0 in 0.579s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:11 devstack sudo[99266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1
Aug 26 03:09:11 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:12 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1" returned: 0 in 0.555s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Attempting download of fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 2780c1ac-250a-4403-a38a-cdd65d0df5c1. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f7c2c-2400-447b-bdfc-2fee55175181]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:12 devstack sudo[99269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg
Aug 26 03:09:12 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:12 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:09:12 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:12 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg" returned: 0 in 0.660s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:13 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.513s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:09:13 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg
Aug 26 03:09:13 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:13 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg" returned: 1 in 0.644s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_bl1qqivg' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[183c4a04-29e7-4287-8ef2-06682432abe1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:13 devstack sudo[99282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD
Aug 26 03:09:13 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:14 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:14 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] fbacabb5-c169-4db6-835c-c8c852a95048 was qcow2, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:09:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:14 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1
Aug 26 03:09:14 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:18 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1" returned: 0 in 3.731s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_zzczc8z6devstack@QuobyteHD, size 112.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:09:18 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Converted 112.00 MB image at 30.01 MB/s
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:18 devstack sudo[99336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 1G
Aug 26 03:09:18 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:18 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 1G" returned: 0 in 0.716s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Downloaded image fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 2780c1ac-250a-4403-a38a-cdd65d0df5c1 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 for user f646d4c8c23246448fe73970c060a2b2 is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Marking volume 2780c1ac-250a-4403-a38a-cdd65d0df5c1 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Copying metadata from image fbacabb5-c169-4db6-835c-c8c852a95048 to 2780c1ac-250a-4403-a38a-cdd65d0df5c1. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:09:18 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Creating volume glance metadata for volume 2780c1ac-250a-4403-a38a-cdd65d0df5c1 backed by image fbacabb5-c169-4db6-835c-c8c852a95048 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:09:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c63497b-8e06-409c-8b6f-ebff05683771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb120170>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd26f23f-e13a-4233-9fa6-bf3cff46d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:19 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Volume volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 (2780c1ac-250a-4403-a38a-cdd65d0df5c1): created successfully
Aug 26 03:09:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd26f23f-e13a-4233-9fa6-bf3cff46d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Flow 'volume_create_manager' (ab2f8595-28e3-49ca-8817-30941ae600b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:19 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f2794102-6440-4a9e-b81b-933ef3ffcaa8 tempest-VolumesImageMetadata-1386818738 None] Created volume successfully.
Aug 26 03:09:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Acquiring lock "cinder-2780c1ac-250a-4403-a38a-cdd65d0df5c1-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Lock "cinder-2780c1ac-250a-4403-a38a-cdd65d0df5c1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Acquiring lock "cinder-quobyte-2780c1ac-250a-4403-a38a-cdd65d0df5c1" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Lock "cinder-quobyte-2780c1ac-250a-4403-a38a-cdd65d0df5c1" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:20 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c989af-d808-4f47-8746-298f3c5bb833]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:21 devstack sudo[99345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1
Aug 26 03:09:21 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:21 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1" returned: 0 in 0.489s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:21 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1
Aug 26 03:09:21 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:21 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2780c1ac-250a-4403-a38a-cdd65d0df5c1" returned: 0 in 0.338s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Lock "cinder-quobyte-2780c1ac-250a-4403-a38a-cdd65d0df5c1" released by "delete_volume" :: held 0.897s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:21 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Created reservations ['89e7d174-eee7-4912-bf24-7dbffee7691c', 'ae73d665-7720-4bcd-b5a2-ce8ef2757450', '459b11b7-3ab7-4483-b1d4-f61a03710114', '1768ab84-bea9-4506-b51a-af7ebd9a0b38'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:22 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:09:22 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:22 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.284s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:09:22 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Deleted volume successfully.
Aug 26 03:09:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ea0df90-0dc7-4f11-91ce-ab1b5b83edd3 tempest-VolumesImageMetadata-1386818738 None] Lock "cinder-2780c1ac-250a-4403-a38a-cdd65d0df5c1-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Flow 'volume_create_manager' (b022d435-3491-4515-a84a-d6c913a05639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfc8bfc-6c61-4bb1-b815-44786fb97e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfc8bfc-6c61-4bb1-b815-44786fb97e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1154681272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a419b1b6-88a3-4261-92f6-536254a3c874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1cafd3ee8c480bace265f87a752a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:30Z,use_quota=True,user_id='924ba401b84c4e078a2169e93e964ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67023018-ff5b-44aa-b19a-dd09ad5c47eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67023018-ff5b-44aa-b19a-dd09ad5c47eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c56913b-b550-4c51-9729-80afa0273aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c56913b-b550-4c51-9729-80afa0273aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a419b1b6-88a3-4261-92f6-536254a3c874', 'volume_name': 'volume-a419b1b6-88a3-4261-92f6-536254a3c874', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f43461-21aa-4dbf-b6bd-98976837bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f43461-21aa-4dbf-b6bd-98976837bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98950f7a-e037-4485-a991-fd95b1371615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:29 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Volume a419b1b6-88a3-4261-92f6-536254a3c874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a419b1b6-88a3-4261-92f6-536254a3c874', 'volume_size': 1}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1154681272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a419b1b6-88a3-4261-92f6-536254a3c874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1cafd3ee8c480bace265f87a752a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:30Z,use_quota=True,user_id='924ba401b84c4e078a2169e93e964ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Creating volume a419b1b6-88a3-4261-92f6-536254a3c874 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:09:29 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:09:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:29 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874 1073741824
Aug 26 03:09:29 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:30 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874 1073741824" returned: 0 in 0.683s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:30 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874
Aug 26 03:09:30 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:30 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874" returned: 0 in 0.467s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98950f7a-e037-4485-a991-fd95b1371615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a419b1b6-88a3-4261-92f6-536254a3c874', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00a1ecb-060e-4d8f-8ede-2f5c1b82c5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:30 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Volume volume-a419b1b6-88a3-4261-92f6-536254a3c874 (a419b1b6-88a3-4261-92f6-536254a3c874): created successfully
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00a1ecb-060e-4d8f-8ede-2f5c1b82c5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Flow 'volume_create_manager' (b022d435-3491-4515-a84a-d6c913a05639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b459744d-4aef-4737-ac59-6e0f9ed116ab tempest-VolumesTransfersTest-435012051 None] Created volume successfully.
Aug 26 03:09:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f95ce468-5c2c-4bf6-98e6-2de83f390ef5 tempest-VolumesTransfersTest-845431041 None] Transfer volume completed successfully.
Aug 26 03:09:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Acquiring lock "cinder-a419b1b6-88a3-4261-92f6-536254a3c874-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Lock "cinder-a419b1b6-88a3-4261-92f6-536254a3c874-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Acquiring lock "cinder-quobyte-a419b1b6-88a3-4261-92f6-536254a3c874" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Lock "cinder-quobyte-a419b1b6-88a3-4261-92f6-536254a3c874" acquired by "delete_volume" :: waited 0.056s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e10152-db3a-47c0-80a6-700fb1870765]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:34 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874
Aug 26 03:09:34 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-399d7f80-271e-436d-8ca9-44191d6e9af6 tempest-ServerActionsTestOtherA-1838051355 None] Terminate volume connection completed successfully.
Aug 26 03:09:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-399d7f80-271e-436d-8ca9-44191d6e9af6 tempest-ServerActionsTestOtherA-1838051355 None] Deleting attachment 49a7ea75-6344-45df-b134-f8f167048e1f. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:09:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "cinder-2106fb91-95b9-48ac-941a-5cf34b925a23-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-2106fb91-95b9-48ac-941a-5cf34b925a23-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:35 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874" returned: 0 in 1.009s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "cinder-quobyte-2106fb91-95b9-48ac-941a-5cf34b925a23" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:35 devstack sudo[99580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874
Aug 26 03:09:35 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-quobyte-2106fb91-95b9-48ac-941a-5cf34b925a23" acquired by "delete_volume" :: waited 0.059s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0112348f-41de-45ee-b260-7ead7166b82d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:35 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23
Aug 26 03:09:35 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:35 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a419b1b6-88a3-4261-92f6-536254a3c874" returned: 0 in 0.588s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Lock "cinder-quobyte-a419b1b6-88a3-4261-92f6-536254a3c874" released by "delete_volume" :: held 1.687s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Created reservations ['cc4cae86-ba4b-49a4-9cc3-8b2965850c08', 'e126de0f-bbb0-42ef-b0f7-d12936e80630', 'c34d7459-1dd4-4f12-a91f-9b20ca55737c', '70e972c1-7f79-48c7-aecc-855be35e8905'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:09:35 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23" returned: 0 in 0.619s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:35 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23
Aug 26 03:09:35 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:35 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:09:35 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:36 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:09:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Deleted volume successfully.
Aug 26 03:09:36 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2106fb91-95b9-48ac-941a-5cf34b925a23" returned: 0 in 0.395s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-quobyte-2106fb91-95b9-48ac-941a-5cf34b925a23" released by "delete_volume" :: held 1.103s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c747e43f-b525-4bed-a270-a4eaccd557c8 tempest-VolumesTransfersTest-498857795 None] Lock "cinder-a419b1b6-88a3-4261-92f6-536254a3c874-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.quota [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Created reservations ['a41b33fb-70c3-4bf6-92d0-3ed241ead1e5', '1871562b-0f97-47a7-8fd9-66c855c17faa', 'c1b1f63e-143c-4e5c-8ccf-7aae4a60e962', '00e544e2-d043-4b7f-9f8a-0c76878b5baf'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "cinder-1d062711-0517-4bc0-83ec-ecc4e371ed4c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:36 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:09:36 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-1d062711-0517-4bc0-83ec-ecc4e371ed4c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "cinder-quobyte-1d062711-0517-4bc0-83ec-ecc4e371ed4c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-quobyte-1d062711-0517-4bc0-83ec-ecc4e371ed4c" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753904c-0a42-4e23-9b0a-063185b53095]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:36 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.334s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.manager [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:09:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Deleted volume successfully.
Aug 26 03:09:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-51cd318f-14e8-47d1-8ba5-94370e5e4fa2 req-893cd6b1-042c-42dd-8767-2d0a2e654cab tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-2106fb91-95b9-48ac-941a-5cf34b925a23-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:37 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c
Aug 26 03:09:37 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Flow 'volume_create_manager' (06215546-4806-4477-aba9-d471cd3b3d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31620861-424c-411c-b25e-95f855271d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31620861-424c-411c-b25e-95f855271d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-320440345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00dd9b4-26b8-46e7-b50a-1823483f5fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1cafd3ee8c480bace265f87a752a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:37Z,use_quota=True,user_id='924ba401b84c4e078a2169e93e964ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34c9cf5-7f25-44cf-9d60-e88f1bdb0503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34c9cf5-7f25-44cf-9d60-e88f1bdb0503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4384404-ac22-4d26-8c79-5d79a5134393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4384404-ac22-4d26-8c79-5d79a5134393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd00dd9b4-26b8-46e7-b50a-1823483f5fd5', 'volume_name': 'volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d288cb3b-27ee-4d46-9b41-1e738459ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d288cb3b-27ee-4d46-9b41-1e738459ab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6656ff-4869-4470-b02d-63518f5eb062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Volume d00dd9b4-26b8-46e7-b50a-1823483f5fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5', 'volume_size': 1}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-320440345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00dd9b4-26b8-46e7-b50a-1823483f5fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1cafd3ee8c480bace265f87a752a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:37Z,use_quota=True,user_id='924ba401b84c4e078a2169e93e964ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Creating volume d00dd9b4-26b8-46e7-b50a-1823483f5fd5 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:09:37 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:37 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c" returned: 0 in 0.706s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:37 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 1073741824
Aug 26 03:09:37 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:37 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c
Aug 26 03:09:37 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:37 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1d062711-0517-4bc0-83ec-ecc4e371ed4c" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-quobyte-1d062711-0517-4bc0-83ec-ecc4e371ed4c" released by "delete_volume" :: held 1.132s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:37 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Created reservations ['bcb52e64-acd9-4fd5-a276-d61e4b2f6784', '2b1ffb75-8405-49a2-963b-f9e6b737e748', 'd2e68f49-dc89-4d4d-907e-1bd971608c7c', '13d664e0-cfa9-41d7-8adf-46ad11318bf3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:38 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:09:38 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:38 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 1073741824" returned: 0 in 0.692s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:38 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5
Aug 26 03:09:38 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:38 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.362s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:09:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Deleted volume successfully.
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b28ca288-f8dd-4c59-b9d2-ec8fce8855d5 tempest-ServerActionsTestOtherA-1838051355 None] Lock "cinder-1d062711-0517-4bc0-83ec-ecc4e371ed4c-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:38 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5" returned: 0 in 0.320s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6656ff-4869-4470-b02d-63518f5eb062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b004c338-3d66-4f2b-98d4-a8f4687cfb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:38 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Volume volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 (d00dd9b4-26b8-46e7-b50a-1823483f5fd5): created successfully
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b004c338-3d66-4f2b-98d4-a8f4687cfb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Flow 'volume_create_manager' (06215546-4806-4477-aba9-d471cd3b3d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b9e8683c-c89e-4e0c-a52b-ecf5ad37d4f7 tempest-VolumesTransfersTest-435012051 None] Created volume successfully.
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Acquiring lock "cinder-d00dd9b4-26b8-46e7-b50a-1823483f5fd5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Lock "cinder-d00dd9b4-26b8-46e7-b50a-1823483f5fd5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Acquiring lock "cinder-quobyte-d00dd9b4-26b8-46e7-b50a-1823483f5fd5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Lock "cinder-quobyte-d00dd9b4-26b8-46e7-b50a-1823483f5fd5" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e6ba1-325d-4fef-9632-ba57fc567d14]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:40 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5
Aug 26 03:09:40 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:40 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5" returned: 0 in 0.635s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:41 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5
Aug 26 03:09:41 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:41 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d00dd9b4-26b8-46e7-b50a-1823483f5fd5" returned: 0 in 0.352s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Lock "cinder-quobyte-d00dd9b4-26b8-46e7-b50a-1823483f5fd5" released by "delete_volume" :: held 1.045s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Created reservations ['b211f919-3fce-40a4-8ffe-b74a4ea1e6fd', '34f32a12-72c8-43af-b940-73d29251542b', '6aacedb4-1be3-42ff-bfdd-ec3092803bab', 'a6d1100e-f99e-45af-88db-1c5241482c15'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:41 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:09:41 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:42 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.568s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:42 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:09:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Deleted volume successfully.
Aug 26 03:09:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-04964e78-be0f-4d0e-884a-620c4658761c tempest-VolumesTransfersTest-498857795 None] Lock "cinder-d00dd9b4-26b8-46e7-b50a-1823483f5fd5-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:09:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-dda58331-2f3e-4146-92a1-47807e62e244 req-20ae7750-40b3-45ab-a0cf-6cb0fa0090bf tempest-TaggedAttachmentsTest-568189047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-dda58331-2f3e-4146-92a1-47807e62e244 req-20ae7750-40b3-45ab-a0cf-6cb0fa0090bf tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-dda58331-2f3e-4146-92a1-47807e62e244 req-20ae7750-40b3-45ab-a0cf-6cb0fa0090bf tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-dda58331-2f3e-4146-92a1-47807e62e244 req-20ae7750-40b3-45ab-a0cf-6cb0fa0090bf tempest-TaggedAttachmentsTest-568189047 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-87d7a68d-26b9-48d8-a745-95485618e07b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95c738c0-8fac-42f3-98c1-432858738f41', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:09:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-dda58331-2f3e-4146-92a1-47807e62e244 req-20ae7750-40b3-45ab-a0cf-6cb0fa0090bf tempest-TaggedAttachmentsTest-568189047 None] attachment_update completed successfully.
Aug 26 03:09:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-3c256afa-00ae-429f-b1d6-6960dd381b9b req-b544d94e-2720-41dc-ae38-1a9552afc35b tempest-TaggedAttachmentsTest-568189047 None] Terminate volume connection completed successfully.
Aug 26 03:09:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-3c256afa-00ae-429f-b1d6-6960dd381b9b req-b544d94e-2720-41dc-ae38-1a9552afc35b tempest-TaggedAttachmentsTest-568189047 None] Deleting attachment 95c738c0-8fac-42f3-98c1-432858738f41. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Flow 'volume_create_manager' (36d74e91-e130-439c-b162-e48989716a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1442c37-2767-4453-b473-3975bfabebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1442c37-2767-4453-b473-3975bfabebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1837413881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf08db61-f5d8-42d4-9e8b-284d7fb048b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07187343375a4910a49e27c1f556e053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:55Z,use_quota=True,user_id='b9f36fbe5b474b9c95df78bf157817d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11658238-a7a2-48fe-881b-328c9565ac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11658238-a7a2-48fe-881b-328c9565ac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32314d11-9f30-404b-8d2d-07a4576c2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32314d11-9f30-404b-8d2d-07a4576c2d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf08db61-f5d8-42d4-9e8b-284d7fb048b6', 'volume_name': 'volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d90cf61-2e3e-487b-9ba3-1d7d412ad367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d90cf61-2e3e-487b-9ba3-1d7d412ad367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd64e77-daf3-430b-aaf9-26312f449001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Volume cf08db61-f5d8-42d4-9e8b-284d7fb048b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6', 'volume_size': 1}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1837413881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf08db61-f5d8-42d4-9e8b-284d7fb048b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07187343375a4910a49e27c1f556e053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:55Z,use_quota=True,user_id='b9f36fbe5b474b9c95df78bf157817d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Creating volume cf08db61-f5d8-42d4-9e8b-284d7fb048b6 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:09:55 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:55 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 1073741824
Aug 26 03:09:55 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:55 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 1073741824" returned: 0 in 0.842s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:56 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6
Aug 26 03:09:56 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:56 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6" returned: 0 in 0.341s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd64e77-daf3-430b-aaf9-26312f449001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df1d5c5-376c-4d5f-bc2e-627a35a4b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:56 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Volume volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 (cf08db61-f5d8-42d4-9e8b-284d7fb048b6): created successfully
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df1d5c5-376c-4d5f-bc2e-627a35a4b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Flow 'volume_create_manager' (36d74e91-e130-439c-b162-e48989716a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:56 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-adc63c97-ee38-4073-9d2d-0f554493f7d2 tempest-VolumesTransfersV357Test-1179442190 None] Created volume successfully.
Aug 26 03:09:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8533dbf8-bb20-490f-94b2-c5baac6a3635 tempest-VolumesTransfersV357Test-1290803625 None] Transfer volume completed successfully.
Aug 26 03:09:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Acquiring lock "cinder-cf08db61-f5d8-42d4-9e8b-284d7fb048b6-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-cf08db61-f5d8-42d4-9e8b-284d7fb048b6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Acquiring lock "cinder-quobyte-cf08db61-f5d8-42d4-9e8b-284d7fb048b6" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:09:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-quobyte-cf08db61-f5d8-42d4-9e8b-284d7fb048b6" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:09:58 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eef796-2b14-42f4-ae64-54d036e7551c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:09:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:59 devstack sudo[100265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6
Aug 26 03:09:59 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:09:59 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Flow 'volume_create_manager' (6159185b-5302-435b-8e6e-c9a318459887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7173f1f7-da11-4789-8b69-1f4a7f536212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6" returned: 0 in 0.613s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7173f1f7-da11-4789-8b69-1f4a7f536212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1196369099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f71d21-6061-43d8-94a8-44f1357a6e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babc352414c04b83b3509231fa7b140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:59Z,use_quota=True,user_id='15ec8f26dd8f48e0b0bb54c0ea14d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010cc26d-e79e-401d-9540-4ac143e7713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010cc26d-e79e-401d-9540-4ac143e7713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:59 devstack sudo[100271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6
Aug 26 03:09:59 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5ec16e-2175-49e8-bc58-9eeeda58814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5ec16e-2175-49e8-bc58-9eeeda58814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f71d21-6061-43d8-94a8-44f1357a6e58', 'volume_name': 'volume-59f71d21-6061-43d8-94a8-44f1357a6e58', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d62fa-1c80-42e9-894d-1a6bc28a650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27d62fa-1c80-42e9-894d-1a6bc28a650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dc75d9-9fe4-49b5-8640-250e0ed94bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:09:59 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Volume 59f71d21-6061-43d8-94a8-44f1357a6e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f71d21-6061-43d8-94a8-44f1357a6e58', 'volume_size': 1}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1196369099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f71d21-6061-43d8-94a8-44f1357a6e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babc352414c04b83b3509231fa7b140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:59Z,use_quota=True,user_id='15ec8f26dd8f48e0b0bb54c0ea14d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Creating volume 59f71d21-6061-43d8-94a8-44f1357a6e58 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:09:59 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:09:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:09:59 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58 1073741824
Aug 26 03:09:59 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:00 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-cf08db61-f5d8-42d4-9e8b-284d7fb048b6" returned: 0 in 0.458s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-quobyte-cf08db61-f5d8-42d4-9e8b-284d7fb048b6" released by "delete_volume" :: held 1.148s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Created reservations ['6c7bd0e2-d8f7-440e-bddb-3aa74696e907', '8ff1d32d-e09b-47af-8449-762856c31c93', 'cdb274ed-26a8-4617-94d8-1443dc6d5aa9', 'deb7524d-5215-400e-92c4-3da810f68def'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:00 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:10:00 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:00 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58 1073741824" returned: 0 in 0.840s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:00 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58
Aug 26 03:10:00 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:00 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:10:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Deleted volume successfully.
Aug 26 03:10:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0da45215-a8e9-4529-9903-7445827e7fc8 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-cf08db61-f5d8-42d4-9e8b-284d7fb048b6-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:01 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58" returned: 0 in 0.504s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dc75d9-9fe4-49b5-8640-250e0ed94bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f71d21-6061-43d8-94a8-44f1357a6e58', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb01de-3cd6-4025-8546-70c8956359ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:01 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Volume volume-59f71d21-6061-43d8-94a8-44f1357a6e58 (59f71d21-6061-43d8-94a8-44f1357a6e58): created successfully
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6beb01de-3cd6-4025-8546-70c8956359ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Flow 'volume_create_manager' (6159185b-5302-435b-8e6e-c9a318459887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-26862c61-0cee-4893-a8d8-5218131d046c tempest-AttachVolumeTestJSON-2052491606 None] Created volume successfully.
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Flow 'volume_create_manager' (d16e34dc-95ba-49d0-a7b2-84418a1aecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027add6b-5695-4d9e-90b7-1e251c3388a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027add6b-5695-4d9e-90b7-1e251c3388a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1636939085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ffba5f-11e2-4616-adcc-db73553fd915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07187343375a4910a49e27c1f556e053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:02Z,use_quota=True,user_id='b9f36fbe5b474b9c95df78bf157817d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acefce0-e86e-4471-8bd5-91e53dff167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acefce0-e86e-4471-8bd5-91e53dff167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0634c-595d-4cc8-b092-1ad2cd350ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0634c-595d-4cc8-b092-1ad2cd350ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ffba5f-11e2-4616-adcc-db73553fd915', 'volume_name': 'volume-33ffba5f-11e2-4616-adcc-db73553fd915', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7e885f-c3a4-490c-b2a9-fddf00a037ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7e885f-c3a4-490c-b2a9-fddf00a037ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0b2e98-f158-47b3-b4c0-9748378aadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:02 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Volume 33ffba5f-11e2-4616-adcc-db73553fd915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ffba5f-11e2-4616-adcc-db73553fd915', 'volume_size': 1}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1636939085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ffba5f-11e2-4616-adcc-db73553fd915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07187343375a4910a49e27c1f556e053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:02Z,use_quota=True,user_id='b9f36fbe5b474b9c95df78bf157817d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Creating volume 33ffba5f-11e2-4616-adcc-db73553fd915 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:10:02 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:02 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915 1073741824
Aug 26 03:10:02 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:02 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915 1073741824" returned: 0 in 0.682s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-4dd2991c-8f0a-41ac-8078-afe7312297db req-f1ec0ae2-43ac-4cc1-9eae-339b172b9c56 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:02 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915
Aug 26 03:10:02 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:03 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-4dd2991c-8f0a-41ac-8078-afe7312297db req-f1ec0ae2-43ac-4cc1-9eae-339b172b9c56 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.426s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0b2e98-f158-47b3-b4c0-9748378aadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ffba5f-11e2-4616-adcc-db73553fd915', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbc8ae3-f007-41c2-b13a-53c4b84bb7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-4dd2991c-8f0a-41ac-8078-afe7312297db req-f1ec0ae2-43ac-4cc1-9eae-339b172b9c56 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:03 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Volume volume-33ffba5f-11e2-4616-adcc-db73553fd915 (33ffba5f-11e2-4616-adcc-db73553fd915): created successfully
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbc8ae3-f007-41c2-b13a-53c4b84bb7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Flow 'volume_create_manager' (d16e34dc-95ba-49d0-a7b2-84418a1aecd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c9a8cd9b-b835-4880-b6c8-56171f797a3f tempest-VolumesTransfersV357Test-1179442190 None] Created volume successfully.
Aug 26 03:10:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-4dd2991c-8f0a-41ac-8078-afe7312297db req-f1ec0ae2-43ac-4cc1-9eae-339b172b9c56 tempest-AttachVolumeTestJSON-2052491606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-59f71d21-6061-43d8-94a8-44f1357a6e58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1767338a-e661-4e2e-b36c-623b728844cc', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:10:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-4dd2991c-8f0a-41ac-8078-afe7312297db req-f1ec0ae2-43ac-4cc1-9eae-339b172b9c56 tempest-AttachVolumeTestJSON-2052491606 None] attachment_update completed successfully.
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Acquiring lock "cinder-33ffba5f-11e2-4616-adcc-db73553fd915-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-33ffba5f-11e2-4616-adcc-db73553fd915-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=78,cinder:SELECT=62,cinder:INSERT=19,cinder:DELETE=6 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=70,cinder:INSERT=24,cinder:UPDATE=64,cinder:DELETE=6 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Acquiring lock "cinder-quobyte-33ffba5f-11e2-4616-adcc-db73553fd915" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-quobyte-33ffba5f-11e2-4616-adcc-db73553fd915" acquired by "delete_volume" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d952dc-d65d-4fcf-933d-71d11d2c4939]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:04 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915
Aug 26 03:10:04 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:05 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915" returned: 0 in 0.709s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:05 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915
Aug 26 03:10:05 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Acquiring lock "cinder-87d7a68d-26b9-48d8-a745-95485618e07b-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Lock "cinder-87d7a68d-26b9-48d8-a745-95485618e07b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Acquiring lock "cinder-quobyte-87d7a68d-26b9-48d8-a745-95485618e07b" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Lock "cinder-quobyte-87d7a68d-26b9-48d8-a745-95485618e07b" acquired by "delete_volume" :: waited 0.043s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:05 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33ffba5f-11e2-4616-adcc-db73553fd915" returned: 0 in 0.462s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[03973980-f297-4b49-a32e-db11bf8c2d5b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-quobyte-33ffba5f-11e2-4616-adcc-db73553fd915" released by "delete_volume" :: held 1.281s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:06 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b
Aug 26 03:10:06 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Created reservations ['9e0eb010-0cb3-4442-9a52-d90a53d20b1f', '5c0f8bdb-5938-4ea6-99ed-ed2708d45109', 'ef2acdd2-48fc-4bf5-a515-2b9045812e68', '2436a8dc-3494-4190-be59-ef8688207d94'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:06 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:10:06 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:06 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b" returned: 0 in 0.620s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:06 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b
Aug 26 03:10:06 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:06 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:10:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Deleted volume successfully.
Aug 26 03:10:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18ae3dd2-4410-4f2c-88d2-b5ce8d283a32 tempest-VolumesTransfersV357Test-115893707 None] Lock "cinder-33ffba5f-11e2-4616-adcc-db73553fd915-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:07 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-87d7a68d-26b9-48d8-a745-95485618e07b" returned: 0 in 0.620s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Lock "cinder-quobyte-87d7a68d-26b9-48d8-a745-95485618e07b" released by "delete_volume" :: held 1.315s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Created reservations ['7b2162ab-2383-4a82-957a-78ae33bde8b1', '66804737-bf12-455e-a1d8-e0df7554f325', 'f0306bbe-74d0-4b57-b7e0-424e512e931c', 'b52841be-3377-47fb-8435-6d95fb911ab7'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:07 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:10:07 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:07 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:10:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Deleted volume successfully.
Aug 26 03:10:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c68d9c2-f6a4-4ac8-bbae-5aafe73954ea tempest-TaggedAttachmentsTest-568189047 None] Lock "cinder-87d7a68d-26b9-48d8-a745-95485618e07b-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:12 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:10:12 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:12 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.428s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:10:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:10:17 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:10:17 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=7,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Flow 'volume_create_manager' (06382661-7bfd-44c5-ae3f-f1a93a2d8c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bf30f4-7f64-4b5d-9c27-40d836e3ecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bf30f4-7f64-4b5d-9c27-40d836e3ecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1743225511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713d7f06-11a8-4290-85a1-921122d29f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050ce9c6c049ba917d23b70e15fe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:18Z,use_quota=True,user_id='2addca0cebe84a81b60b06e4bdcedda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111d1aaf-409d-428e-abc8-15f4d75c29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111d1aaf-409d-428e-abc8-15f4d75c29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b504409-b6db-4271-98b6-7bc8021e74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b504409-b6db-4271-98b6-7bc8021e74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713d7f06-11a8-4290-85a1-921122d29f7c', 'volume_name': 'volume-713d7f06-11a8-4290-85a1-921122d29f7c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb08fb-04c6-4761-9c55-8b40f77beb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb08fb-04c6-4761-9c55-8b40f77beb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43a29f8-7324-4673-a92d-98549f733363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:18 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Volume 713d7f06-11a8-4290-85a1-921122d29f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713d7f06-11a8-4290-85a1-921122d29f7c', 'volume_size': 1}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1743225511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713d7f06-11a8-4290-85a1-921122d29f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050ce9c6c049ba917d23b70e15fe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:18Z,use_quota=True,user_id='2addca0cebe84a81b60b06e4bdcedda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Creating volume 713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:10:18 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:10:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:18 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c 1073741824
Aug 26 03:10:18 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:19 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c 1073741824" returned: 0 in 0.886s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:19 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c
Aug 26 03:10:19 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:19 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c" returned: 0 in 0.327s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43a29f8-7324-4673-a92d-98549f733363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713d7f06-11a8-4290-85a1-921122d29f7c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a89c7-0c56-48ae-baba-8da3e4b9df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:19 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Volume volume-713d7f06-11a8-4290-85a1-921122d29f7c (713d7f06-11a8-4290-85a1-921122d29f7c): created successfully
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a89c7-0c56-48ae-baba-8da3e4b9df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Flow 'volume_create_manager' (06382661-7bfd-44c5-ae3f-f1a93a2d8c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:19 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4a784a91-4f71-49da-8b21-6b480a6ab780 tempest-VolumesCloneTest-1960499423 None] Created volume successfully.
Aug 26 03:10:20 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Flow 'volume_create_manager' (c6cc2472-cb08-44cd-991a-264d0326d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c0804c-4b55-488a-9d07-74be84764835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c0804c-4b55-488a-9d07-74be84764835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-337695819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f48d8de-78ba-444c-bf27-bc55d64b5040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23050ce9c6c049ba917d23b70e15fe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=713d7f06-11a8-4290-85a1-921122d29f7c,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:21Z,use_quota=True,user_id='2addca0cebe84a81b60b06e4bdcedda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e618cd2c-f3ec-4cbe-a846-f5393e093d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e618cd2c-f3ec-4cbe-a846-f5393e093d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa7ae1a-848e-4d5b-b6af-0ad49df1fc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa7ae1a-848e-4d5b-b6af-0ad49df1fc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0f48d8de-78ba-444c-bf27-bc55d64b5040', 'volume_name': 'volume-0f48d8de-78ba-444c-bf27-bc55d64b5040', 'volume_size': 2, 'source_volid': '713d7f06-11a8-4290-85a1-921122d29f7c', 'source_volstatus': 'available'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23751340-ecaa-4d40-8e95-96f0f7d64145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23751340-ecaa-4d40-8e95-96f0f7d64145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af68617b-de58-4abe-9b1d-7cb11aca8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Volume 0f48d8de-78ba-444c-bf27-bc55d64b5040: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0f48d8de-78ba-444c-bf27-bc55d64b5040', 'volume_size': 2, 'source_volid': '713d7f06-11a8-4290-85a1-921122d29f7c', 'source_volstatus': 'available'}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:21 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Cloning volume 713d7f06-11a8-4290-85a1-921122d29f7c to volume 0f48d8de-78ba-444c-bf27-bc55d64b5040
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Creating offline snapshot 3b4caf3c-e217-4a0a-ad71-3242e6100692 of volume 713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f9a03-467a-4d8f-a998-0bb11f8312f3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:21 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c
Aug 26 03:10:21 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:21 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:21 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 1G
Aug 26 03:10:21 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:22 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 1G" returned: 0 in 0.626s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713d7f06-11a8-4290-85a1-921122d29f7c -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:22 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713d7f06-11a8-4290-85a1-921122d29f7c -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692
Aug 26 03:10:22 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:22 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-713d7f06-11a8-4290-85a1-921122d29f7c -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692" returned: 0 in 0.468s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:22 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 is being set with open permissions: ugo+rw
Aug 26 03:10:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:22 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692
Aug 26 03:10:22 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:23 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692" returned: 0 in 0.371s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:23 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info
Aug 26 03:10:23 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:23 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info" returned: 0 in 0.347s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:23 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info is being set with open permissions: ugo+rw
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:23 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info
Aug 26 03:10:23 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:23 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.info" returned: 0 in 0.415s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "cinder-quobyte-0f48d8de-78ba-444c-bf27-bc55d64b5040" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-0f48d8de-78ba-444c-bf27-bc55d64b5040" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] snapshot: 3b4caf3c-e217-4a0a-ad71-3242e6100692, volume: 0f48d8de-78ba-444c-bf27-bc55d64b5040,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d1f2f-3cfa-43b6-89ab-12e5e6866081]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:24 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692
Aug 26 03:10:24 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:25 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692" returned: 0 in 1.190s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-713d7f06-11a8-4290-85a1-921122d29f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:10:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaceaa3-8113-4370-a3c1-ac0a1b82a26f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:25 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c
Aug 26 03:10:25 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:26 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c" returned: 0 in 0.846s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:10:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:10:26 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:10:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:26 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040
Aug 26 03:10:26 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:33 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:10:33 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:10:36 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040" returned: 0 in 10.226s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:36 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c, size 1024.00 MB, duration 10.23 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:10:36 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Converted 1024.00 MB image at 100.10 MB/s
Aug 26 03:10:36 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 is being set with open permissions: ugo+rw
Aug 26 03:10:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:36 devstack sudo[101601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040
Aug 26 03:10:36 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:37 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040" returned: 0 in 0.669s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-0f48d8de-78ba-444c-bf27-bc55d64b5040" released by "_copy_volume_from_snapshot" :: held 13.082s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "cinder-quobyte-3b4caf3c-e217-4a0a-ad71-3242e6100692" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-3b4caf3c-e217-4a0a-ad71-3242e6100692" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Deleting offline snapshot 3b4caf3c-e217-4a0a-ad71-3242e6100692 of volume 713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] snapshot_file for this snap is: volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4e2d80-3e86-4f27-a9e0-a0ee9eefc010]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:37 devstack sudo[101607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692
Aug 26 03:10:37 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:37 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692" returned: 0 in 0.524s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-713d7f06-11a8-4290-85a1-921122d29f7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea9ee9-51d9-4bd1-8731-6e5a125eff04]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:38 devstack sudo[101613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c
Aug 26 03:10:38 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:38 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c" returned: 0 in 0.829s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:38 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692
Aug 26 03:10:38 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:39 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692" returned: 0 in 0.567s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:39 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692
Aug 26 03:10:39 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:39 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c.3b4caf3c-e217-4a0a-ad71-3242e6100692" returned: 0 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-3b4caf3c-e217-4a0a-ad71-3242e6100692" released by "_delete_snapshot" :: held 2.457s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.493s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af68617b-de58-4abe-9b1d-7cb11aca8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f48d8de-78ba-444c-bf27-bc55d64b5040', 'volume_size': 2, 'source_volid': '713d7f06-11a8-4290-85a1-921122d29f7c', 'source_volstatus': 'available'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130a30e2-d757-4d39-a6cf-312e745c83ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:39 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Volume volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 (0f48d8de-78ba-444c-bf27-bc55d64b5040): created successfully
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130a30e2-d757-4d39-a6cf-312e745c83ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Flow 'volume_create_manager' (c6cc2472-cb08-44cd-991a-264d0326d078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2a26745b-9ebf-4848-b2c6-8ef1abb94ee4 tempest-VolumesCloneTest-1960499423 None] Created volume successfully.
Aug 26 03:10:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "cinder-0f48d8de-78ba-444c-bf27-bc55d64b5040-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-0f48d8de-78ba-444c-bf27-bc55d64b5040-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "cinder-quobyte-0f48d8de-78ba-444c-bf27-bc55d64b5040" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-0f48d8de-78ba-444c-bf27-bc55d64b5040" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c551e21-d965-41f0-a532-1f4f5d607eab]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:40 devstack sudo[101682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040
Aug 26 03:10:40 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:41 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040" returned: 0 in 0.507s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:41 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040
Aug 26 03:10:41 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:41 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f48d8de-78ba-444c-bf27-bc55d64b5040" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-0f48d8de-78ba-444c-bf27-bc55d64b5040" released by "delete_volume" :: held 1.070s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Created reservations ['d3b818db-eebe-47d8-a381-5cf9806eb267', '6cedd2fb-7b08-4cab-a2d2-3292b9ceb1da', '2c6a377c-e5d2-4839-843a-791846284232', '69c74f82-4a53-48bb-85cf-7b83217c4b51'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:42 devstack sudo[101691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:10:42 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:42 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.681s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:10:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Deleted volume successfully.
Aug 26 03:10:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6cbb115-306e-4bd8-bb6a-92853ce80b73 tempest-VolumesCloneTest-1960499423 None] Lock "cinder-0f48d8de-78ba-444c-bf27-bc55d64b5040-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Acquiring lock "cinder-713d7f06-11a8-4290-85a1-921122d29f7c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Lock "cinder-713d7f06-11a8-4290-85a1-921122d29f7c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Acquiring lock "cinder-quobyte-713d7f06-11a8-4290-85a1-921122d29f7c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:10:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-713d7f06-11a8-4290-85a1-921122d29f7c" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:10:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0620e248-8d60-46b6-ac03-d9de360562fb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:43 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c
Aug 26 03:10:43 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:44 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c" returned: 0 in 0.776s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:44 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c
Aug 26 03:10:44 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:44 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-713d7f06-11a8-4290-85a1-921122d29f7c" returned: 0 in 0.503s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Lock "cinder-quobyte-713d7f06-11a8-4290-85a1-921122d29f7c" released by "delete_volume" :: held 1.414s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:44 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Created reservations ['050483f6-00dd-45ed-b9d8-4d4b305b15f7', '5e66c344-3876-4ec1-8261-16eb7b558dfc', '48495f12-b952-4300-b61d-92ecef8afa4e', 'dec02dea-8863-4912-8b1f-51bfb3d158f0'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:45 devstack sudo[101704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:10:45 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Flow 'volume_create_manager' (9c0ce537-d27f-42b6-9f32-6ee7818fb85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7663de79-dbd8-48c4-8a54-77933fac2975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7663de79-dbd8-48c4-8a54-77933fac2975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-95897275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654da209-4fff-43b9-82a9-613e6a8b52b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33be3b69efe049599e359f5a0683b352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:46Z,use_quota=True,user_id='6e3cb3eb1e444974b67c486bd2bc6e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6573c3-14ca-438f-ab6a-f1cfb1bcd69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6573c3-14ca-438f-ab6a-f1cfb1bcd69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c77395-8cc9-4f75-9fcd-b9846208bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c77395-8cc9-4f75-9fcd-b9846208bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654da209-4fff-43b9-82a9-613e6a8b52b5', 'volume_name': 'volume-654da209-4fff-43b9-82a9-613e6a8b52b5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba7635d-a3e1-441d-925b-bc3c871d3470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba7635d-a3e1-441d-925b-bc3c871d3470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca85ce83-4166-4f5e-86df-a52b46182fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Volume 654da209-4fff-43b9-82a9-613e6a8b52b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654da209-4fff-43b9-82a9-613e6a8b52b5', 'volume_size': 1}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-95897275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654da209-4fff-43b9-82a9-613e6a8b52b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33be3b69efe049599e359f5a0683b352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:46Z,use_quota=True,user_id='6e3cb3eb1e444974b67c486bd2bc6e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Creating volume 654da209-4fff-43b9-82a9-613e6a8b52b5 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:10:46 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:46 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5 1073741824
Aug 26 03:10:46 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:46 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 1.161s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:10:46 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Deleted volume successfully.
Aug 26 03:10:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3f1c9796-efdc-468f-83e8-5ef46f76a77d tempest-VolumesCloneTest-1960499423 None] Lock "cinder-713d7f06-11a8-4290-85a1-921122d29f7c-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:10:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-05a209d1-a430-4811-8456-0e2e794003be req-36b9e461-9323-4abd-a6b4-b9aed461db7b tempest-AttachVolumeTestJSON-2052491606 None] Terminate volume connection completed successfully.
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-05a209d1-a430-4811-8456-0e2e794003be req-36b9e461-9323-4abd-a6b4-b9aed461db7b tempest-AttachVolumeTestJSON-2052491606 None] Deleting attachment 1767338a-e661-4e2e-b36c-623b728844cc. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:10:47 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5 1073741824" returned: 0 in 1.044s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:47 devstack sudo[101741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5
Aug 26 03:10:47 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:47 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5" returned: 0 in 0.341s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca85ce83-4166-4f5e-86df-a52b46182fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654da209-4fff-43b9-82a9-613e6a8b52b5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc1065f-fab7-48aa-904d-639662e0e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:47 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Volume volume-654da209-4fff-43b9-82a9-613e6a8b52b5 (654da209-4fff-43b9-82a9-613e6a8b52b5): created successfully
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc1065f-fab7-48aa-904d-639662e0e818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Flow 'volume_create_manager' (9c0ce537-d27f-42b6-9f32-6ee7818fb85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-303016ed-7445-4305-91e3-58f3a59247af tempest-ServerRescueNegativeTestJSON-460741483 None] Created volume successfully.
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Flow 'volume_create_manager' (2ba48e35-a9d9-4d62-8116-4ff170e33ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5665f2f4-8bba-47b3-acab-89c9663f9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5665f2f4-8bba-47b3-acab-89c9663f9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1007761555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c65f8d-1f4e-4bb2-af41-77b0762dd594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301c44fc209b4297958e14781aed8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:52Z,use_quota=True,user_id='0db839af84be42da9c1fb2281a89e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1b1720-95e4-49c6-a02a-90fe83233052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1b1720-95e4-49c6-a02a-90fe83233052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2e8e2c-8561-4259-974c-63be06848750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:52 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:10:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2e8e2c-8561-4259-974c-63be06848750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66c65f8d-1f4e-4bb2-af41-77b0762dd594', 'volume_name': 'volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb0e3740>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb8dbe2-7547-4da2-bde8-76271bf6a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb8dbe2-7547-4da2-bde8-76271bf6a782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:10:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3306f3-5e8c-46a9-b25b-61261d601a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:10:53 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Volume 66c65f8d-1f4e-4bb2-af41-77b0762dd594: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb0e3740>}
Aug 26 03:10:53 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Trying to clone 66c65f8d-1f4e-4bb2-af41-77b0762dd594 from image fbacabb5-c169-4db6-835c-c8c852a95048 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:10:54 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD, size 20.69 MB, duration 1.04 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:10:54 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Image download 20.69 MB at 19.88 MB/s
Aug 26 03:10:54 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b44734-6caf-4d99-b2ab-626071c0ea0d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:54 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD
Aug 26 03:10:54 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:55 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:55 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 is fetched for user 0db839af84be42da9c1fb2281a89e075. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:10:55 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4537d1-a62e-41b5-8fbe-64906816ce7b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:56 devstack sudo[101878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD
Aug 26 03:10:56 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:56 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD" returned: 0 in 1.318s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1007761555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c65f8d-1f4e-4bb2-af41-77b0762dd594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301c44fc209b4297958e14781aed8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:52Z,use_quota=True,user_id='0db839af84be42da9c1fb2281a89e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Creating volume 66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:10:56 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:10:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:56 devstack sudo[101927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 1073741824
Aug 26 03:10:56 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:58 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 1073741824" returned: 0 in 1.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:58 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594
Aug 26 03:10:58 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:58 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594" returned: 0 in 0.669s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:10:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:10:58 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Attempting download of fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 66c65f8d-1f4e-4bb2-af41-77b0762dd594. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:10:59 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b7de15-3a9d-4d34-889b-2a59b6ad3b25]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:10:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_ {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:59 devstack sudo[102022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_
Aug 26 03:10:59 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:10:59 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root
Aug 26 03:10:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_" returned: 0 in 0.542s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:10:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_ {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:10:59 devstack sudo[102027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_
Aug 26 03:10:59 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:00 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_" returned: 1 in 0.902s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_h9aph2n_' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:11:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63ef75c-e073-4e93-a217-c7f965f1c57d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:00 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD
Aug 26 03:11:00 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:01 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:01 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] fbacabb5-c169-4db6-835c-c8c852a95048 was qcow2, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:11:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:01 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594
Aug 26 03:11:01 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:04 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594" returned: 0 in 3.114s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_w0krw21sdevstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:11:04 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Converted 112.00 MB image at 35.94 MB/s
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:04 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 1G
Aug 26 03:11:04 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:04 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 1G" returned: 0 in 0.531s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Downloaded image fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 66c65f8d-1f4e-4bb2-af41-77b0762dd594 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 for user 0db839af84be42da9c1fb2281a89e075 is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Marking volume 66c65f8d-1f4e-4bb2-af41-77b0762dd594 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Copying metadata from image fbacabb5-c169-4db6-835c-c8c852a95048 to 66c65f8d-1f4e-4bb2-af41-77b0762dd594. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:11:04 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Creating volume glance metadata for volume 66c65f8d-1f4e-4bb2-af41-77b0762dd594 backed by image fbacabb5-c169-4db6-835c-c8c852a95048 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:11:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3306f3-5e8c-46a9-b25b-61261d601a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb0e3740>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96ffc49-ceeb-4c8e-bf1e-2aaa4cbc38df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Volume volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 (66c65f8d-1f4e-4bb2-af41-77b0762dd594): created successfully
Aug 26 03:11:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96ffc49-ceeb-4c8e-bf1e-2aaa4cbc38df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Flow 'volume_create_manager' (2ba48e35-a9d9-4d62-8116-4ff170e33ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1c377bc9-4fcf-456c-a8b1-8a296bda5b88 tempest-VolumesExtendTest-1656634512 None] Created volume successfully.
Aug 26 03:11:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce401b03-68e2-490a-911a-54ac8747355d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:07 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594
Aug 26 03:11:07 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:07 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594" returned: 0 in 0.885s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 2G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 2G" returned: 0 in 0.210s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.173s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-764a41e5-9fc2-4adb-81ff-6fcbebb6ca52 tempest-VolumesExtendTest-1656634512 None] Extend volume completed successfully.
Aug 26 03:11:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Acquiring lock "cinder-654da209-4fff-43b9-82a9-613e6a8b52b5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "cinder-654da209-4fff-43b9-82a9-613e6a8b52b5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Acquiring lock "cinder-quobyte-654da209-4fff-43b9-82a9-613e6a8b52b5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "cinder-quobyte-654da209-4fff-43b9-82a9-613e6a8b52b5" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb4810c-96c0-4f64-9105-386fb7fce510]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:08 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5
Aug 26 03:11:08 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:09 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5" returned: 0 in 0.499s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:09 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5
Aug 26 03:11:09 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-66c65f8d-1f4e-4bb2-af41-77b0762dd594-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Lock "cinder-66c65f8d-1f4e-4bb2-af41-77b0762dd594-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-quobyte-66c65f8d-1f4e-4bb2-af41-77b0762dd594" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-66c65f8d-1f4e-4bb2-af41-77b0762dd594" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f46c3f-3a8a-4276-96ab-4d06b5894c9e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:10 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-654da209-4fff-43b9-82a9-613e6a8b52b5" returned: 0 in 0.962s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "cinder-quobyte-654da209-4fff-43b9-82a9-613e6a8b52b5" released by "delete_volume" :: held 1.523s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Created reservations ['ade51e4e-2f6a-4360-af1b-5c65ff2230f7', 'c146248d-6782-4eae-a025-79ac5113e5de', '03dad98f-07a7-4db2-903c-28270bb94691', '1ca6bfbb-31f5-4383-9249-6f824d9677ec'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:10 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594
Aug 26 03:11:10 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:10 devstack sudo[102141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:10 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:10 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594" returned: 0 in 0.682s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:10 devstack sudo[102146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594
Aug 26 03:11:10 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:10 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.436s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Deleted volume successfully.
Aug 26 03:11:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d8775f2-3d50-4c82-9b4c-81e201b8392d tempest-ServerRescueNegativeTestJSON-460741483 None] Lock "cinder-654da209-4fff-43b9-82a9-613e6a8b52b5-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:11 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-66c65f8d-1f4e-4bb2-af41-77b0762dd594" returned: 0 in 0.675s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-66c65f8d-1f4e-4bb2-af41-77b0762dd594" released by "delete_volume" :: held 1.507s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:11 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Created reservations ['b0c17476-a173-4df3-afba-45dc19c94311', 'd843d44e-1579-4137-95ec-7f74caa4baa5', '43d816bb-d2cc-4b96-8d26-79d3786edb7e', 'e3993a9f-9282-4724-937e-fce75d8daaee'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:12 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:12 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:12 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:12 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:12 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.694s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Deleted volume successfully.
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9ee4c3ec-8e62-423b-ab74-291937c50566 tempest-VolumesExtendTest-1656634512 None] Lock "cinder-66c65f8d-1f4e-4bb2-af41-77b0762dd594-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:11:13 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Flow 'volume_create_manager' (f337defd-f94d-49e1-8cfa-c246830c8d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1397282e-0a2f-477a-87a6-b7450ad9226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 1.358s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:11:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1397282e-0a2f-477a-87a6-b7450ad9226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-598478053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff83cb41-43d5-4b22-9fe8-f725add27fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301c44fc209b4297958e14781aed8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:14Z,use_quota=True,user_id='0db839af84be42da9c1fb2281a89e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333974b3-89b4-4ba2-8b71-f9e1df77ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333974b3-89b4-4ba2-8b71-f9e1df77ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3277fc90-96b6-49fa-ad2a-2f3a4d5b58a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3277fc90-96b6-49fa-ad2a-2f3a4d5b58a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff83cb41-43d5-4b22-9fe8-f725add27fa3', 'volume_name': 'volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f332974-62fa-4b8a-8bb4-1b63b88ddd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f332974-62fa-4b8a-8bb4-1b63b88ddd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad49bac8-b88b-4d82-986d-d1a841d07ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Volume ff83cb41-43d5-4b22-9fe8-f725add27fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3', 'volume_size': 1}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-598478053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff83cb41-43d5-4b22-9fe8-f725add27fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301c44fc209b4297958e14781aed8424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:14Z,use_quota=True,user_id='0db839af84be42da9c1fb2281a89e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Creating volume ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:11:14 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:11:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:14 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 1073741824
Aug 26 03:11:14 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:15 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 1073741824" returned: 0 in 1.261s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:15 devstack sudo[102274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3
Aug 26 03:11:15 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:15 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3" returned: 0 in 0.480s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad49bac8-b88b-4d82-986d-d1a841d07ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423dd432-15b9-4c48-936f-79a849037b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:15 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Volume volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 (ff83cb41-43d5-4b22-9fe8-f725add27fa3): created successfully
Aug 26 03:11:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423dd432-15b9-4c48-936f-79a849037b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Flow 'volume_create_manager' (f337defd-f94d-49e1-8cfa-c246830c8d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-dc51f056-9318-4aa3-95cb-9ed1fcd40063 tempest-VolumesExtendTest-1656634512 None] Created volume successfully.
Aug 26 03:11:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Creating offline snapshot 35bc4853-82ce-4f7d-8bda-02e348d1fe41 of volume ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:11:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a09e2-962d-434d-a725-9d9005e5000c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:17 devstack sudo[102285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3
Aug 26 03:11:17 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:18 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3" returned: 0 in 0.431s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:18 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 1G
Aug 26 03:11:18 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:18 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 1G" returned: 0 in 0.596s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:18 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41
Aug 26 03:11:18 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:19 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41" returned: 0 in 0.582s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:19 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 is being set with open permissions: ugo+rw
Aug 26 03:11:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:19 devstack sudo[102308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41
Aug 26 03:11:19 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:20 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41" returned: 0 in 0.712s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:20 devstack sudo[102330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info
Aug 26 03:11:20 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:20 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info" returned: 0 in 0.531s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:20 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info is being set with open permissions: ugo+rw
Aug 26 03:11:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:20 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info
Aug 26 03:11:20 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:21 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.info" returned: 0 in 0.499s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.484s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-644a5852-d7cc-43dd-98ee-5afe48ac9d65 tempest-VolumesExtendTest-1656634512 None] Create snapshot completed successfully
Aug 26 03:11:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afbea6a-2a3c-4a65-8bfa-5596e870cda9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:22 devstack sudo[102343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3
Aug 26 03:11:22 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:23 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3" returned: 0 in 0.868s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 2G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 2G" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.327s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-537a63df-e61b-4e19-abb6-9b8d9bad348a tempest-VolumesExtendTest-1656634512 None] Extend volume completed successfully.
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-35bc4853-82ce-4f7d-8bda-02e348d1fe41-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Lock "cinder-35bc4853-82ce-4f7d-8bda-02e348d1fe41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-quobyte-ff83cb41-43d5-4b22-9fe8-f725add27fa3" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-ff83cb41-43d5-4b22-9fe8-f725add27fa3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-quobyte-35bc4853-82ce-4f7d-8bda-02e348d1fe41" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-35bc4853-82ce-4f7d-8bda-02e348d1fe41" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Deleting offline snapshot 35bc4853-82ce-4f7d-8bda-02e348d1fe41 of volume ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] snapshot_file for this snap is: volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a9b763-eca3-4298-b2ef-fefa9ef1af0a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:25 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41
Aug 26 03:11:25 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:25 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41" returned: 0 in 0.511s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0782e9d8-1bd2-4128-b05d-85799dab22be]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:25 devstack sudo[102377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3
Aug 26 03:11:25 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:26 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3" returned: 0 in 0.592s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:26 devstack sudo[102383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41
Aug 26 03:11:26 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:27 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41" returned: 0 in 0.969s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:27 devstack sudo[102416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41
Aug 26 03:11:27 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:27 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3.35bc4853-82ce-4f7d-8bda-02e348d1fe41" returned: 0 in 0.546s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-35bc4853-82ce-4f7d-8bda-02e348d1fe41" released by "_delete_snapshot" :: held 2.853s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-ff83cb41-43d5-4b22-9fe8-f725add27fa3" released by "delete_snapshot" :: held 2.914s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:28 devstack cinder-volume[94326]: WARNING cinder.quota [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Created reservations ['704ba201-9bb8-4bd4-86a2-68c49ce7b004', '2316b26e-b867-4600-b51f-5b326e89e586', 'bc6b6c28-bb07-4043-9ce2-d061b3e5945f', 'ff2b6ff5-2345-42e2-87e6-94ffb88124a4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Delete snapshot completed successfully.
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e74c1f5-5578-440c-9693-5cf312a6d4fe tempest-VolumesExtendTest-1656634512 None] Lock "cinder-35bc4853-82ce-4f7d-8bda-02e348d1fe41-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-ff83cb41-43d5-4b22-9fe8-f725add27fa3-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Lock "cinder-ff83cb41-43d5-4b22-9fe8-f725add27fa3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Acquiring lock "cinder-quobyte-ff83cb41-43d5-4b22-9fe8-f725add27fa3" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-ff83cb41-43d5-4b22-9fe8-f725add27fa3" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0de2564-fc48-4926-87d5-1f7c8bebdf3c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:29 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3
Aug 26 03:11:29 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:29 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3" returned: 0 in 0.708s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:29 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3
Aug 26 03:11:29 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:29 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff83cb41-43d5-4b22-9fe8-f725add27fa3" returned: 0 in 0.419s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Lock "cinder-quobyte-ff83cb41-43d5-4b22-9fe8-f725add27fa3" released by "delete_volume" :: held 1.292s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Created reservations ['04a8b6f1-27ac-4443-96f3-c784073cefd3', '32b53ca2-eccf-41c9-b49d-881ea1504b17', '761e1132-84af-4cc5-94e4-1aa57bf3266a', 'ed0ce712-95b8-422b-8826-07007a8732a4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:30 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:30 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:30 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.473s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Deleted volume successfully.
Aug 26 03:11:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d932787-16bd-4074-9be5-0c3d0eb0aeec tempest-VolumesExtendTest-1656634512 None] Lock "cinder-ff83cb41-43d5-4b22-9fe8-f725add27fa3-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=63,cinder:SELECT=59,cinder:INSERT=22,cinder:DELETE=2 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=71,cinder:SELECT=48,cinder:DELETE=8,cinder:INSERT=20 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Flow 'volume_create_manager' (9e9a48b8-59a8-40b5-94cf-bbadd0f5d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d654ba73-2c8f-4c75-bb34-72e5b26a2e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d654ba73-2c8f-4c75-bb34-72e5b26a2e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1099955175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26ebb14-070b-48d2-a95a-18438dcaac74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9ced4ff63467f99751c99e668c67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:37Z,use_quota=True,user_id='47bd78ddbbaa409daa520c15bdb0bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1036f7-fc47-4238-8b4e-3f1e1351afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1036f7-fc47-4238-8b4e-3f1e1351afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64edc367-8ba5-46d9-8246-80d8aa70f0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64edc367-8ba5-46d9-8246-80d8aa70f0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26ebb14-070b-48d2-a95a-18438dcaac74', 'volume_name': 'volume-b26ebb14-070b-48d2-a95a-18438dcaac74', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9803fa-f9d2-4c22-b3f4-a391189b7278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9803fa-f9d2-4c22-b3f4-a391189b7278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b41d9f-909b-4fdd-b1e1-f8d142fd0b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Volume b26ebb14-070b-48d2-a95a-18438dcaac74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26ebb14-070b-48d2-a95a-18438dcaac74', 'volume_size': 1}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1099955175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26ebb14-070b-48d2-a95a-18438dcaac74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9ced4ff63467f99751c99e668c67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:37Z,use_quota=True,user_id='47bd78ddbbaa409daa520c15bdb0bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Creating volume b26ebb14-070b-48d2-a95a-18438dcaac74 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:11:37 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:11:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:37 devstack sudo[102560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74 1073741824
Aug 26 03:11:37 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Flow 'volume_create_manager' (0dd7c529-de26-446e-a63d-30445bd15337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc41439-4a99-4fcf-9f7f-167bb39f36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc41439-4a99-4fcf-9f7f-167bb39f36ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1252912891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b47450-f613-4442-acfd-5a44bda5ef8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ae837c1f5c4c1c9a21875df0eed394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:38Z,use_quota=True,user_id='9565c9bcadd04780a1cbb0976184c829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239fce8-7c3f-4d1e-8744-bf0d6a3a7705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239fce8-7c3f-4d1e-8744-bf0d6a3a7705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bf3ed9-78d0-400e-8b5f-007fec1e24da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bf3ed9-78d0-400e-8b5f-007fec1e24da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b47450-f613-4442-acfd-5a44bda5ef8f', 'volume_name': 'volume-37b47450-f613-4442-acfd-5a44bda5ef8f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce6059b-f02a-4daf-b688-935b9df93756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce6059b-f02a-4daf-b688-935b9df93756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abc3d59-3626-48d8-a554-47af0cb19e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:38 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Volume 37b47450-f613-4442-acfd-5a44bda5ef8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b47450-f613-4442-acfd-5a44bda5ef8f', 'volume_size': 1}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:38 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74 1073741824" returned: 0 in 1.111s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:38 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74
Aug 26 03:11:38 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:39 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74" returned: 0 in 0.457s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1252912891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b47450-f613-4442-acfd-5a44bda5ef8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ae837c1f5c4c1c9a21875df0eed394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:38Z,use_quota=True,user_id='9565c9bcadd04780a1cbb0976184c829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Creating volume 37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:11:39 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:39 devstack sudo[102594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f 1073741824
Aug 26 03:11:39 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b41d9f-909b-4fdd-b1e1-f8d142fd0b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26ebb14-070b-48d2-a95a-18438dcaac74', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0fd992-150b-4fd3-a01a-0d52b4721f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:39 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Volume volume-b26ebb14-070b-48d2-a95a-18438dcaac74 (b26ebb14-070b-48d2-a95a-18438dcaac74): created successfully
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0fd992-150b-4fd3-a01a-0d52b4721f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Flow 'volume_create_manager' (9e9a48b8-59a8-40b5-94cf-bbadd0f5d09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6456ace3-ada5-4b7c-84c5-f28f38267f9b tempest-ServersNegativeTestJSON-1832946395 None] Created volume successfully.
Aug 26 03:11:40 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f 1073741824" returned: 0 in 1.009s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:40 devstack sudo[102601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f
Aug 26 03:11:40 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:40 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f" returned: 0 in 0.407s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abc3d59-3626-48d8-a554-47af0cb19e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b47450-f613-4442-acfd-5a44bda5ef8f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec978ff-2ad4-4d2e-b2fd-d02b7727bb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:40 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Volume volume-37b47450-f613-4442-acfd-5a44bda5ef8f (37b47450-f613-4442-acfd-5a44bda5ef8f): created successfully
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec978ff-2ad4-4d2e-b2fd-d02b7727bb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Flow 'volume_create_manager' (0dd7c529-de26-446e-a63d-30445bd15337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-bfccd3b2-b2c3-4373-8db8-a7a515bcbcd3 req-c71467a3-1245-47e1-9302-311ed5c016b2 tempest-VolumesSnapshotsTestJSON-1188382728 None] Created volume successfully.
Aug 26 03:11:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Creating offline snapshot 35a9be46-f3e6-4d56-8029-39334191c568 of volume 37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:11:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5b9cec-18c9-49ff-8ded-4115b4c18e4d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:41 devstack sudo[102605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f
Aug 26 03:11:41 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:42 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f" returned: 0 in 0.554s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:42 devstack sudo[102611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 1G
Aug 26 03:11:42 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Flow 'volume_create_manager' (1a192a5d-3abb-4f83-ab40-6602f4e1bab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d309dd3-b235-4cce-a6b6-b81ad4e9678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d309dd3-b235-4cce-a6b6-b81ad4e9678a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-744136852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9df967-1197-4223-a79c-50bf98abb85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9ced4ff63467f99751c99e668c67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:42Z,use_quota=True,user_id='47bd78ddbbaa409daa520c15bdb0bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d525a499-7f87-4706-9995-096536a0da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d525a499-7f87-4706-9995-096536a0da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedadeaf-6534-4d0c-9ae0-d78f7197e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedadeaf-6534-4d0c-9ae0-d78f7197e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9df967-1197-4223-a79c-50bf98abb85e', 'volume_name': 'volume-4b9df967-1197-4223-a79c-50bf98abb85e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f729380c-23d7-42b8-a1f0-9701f95fec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f729380c-23d7-42b8-a1f0-9701f95fec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2270ea-a135-44c3-8bfe-ddeb098a6847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:42 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Volume 4b9df967-1197-4223-a79c-50bf98abb85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9df967-1197-4223-a79c-50bf98abb85e', 'volume_size': 1}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:42 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 1G" returned: 0 in 0.628s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b47450-f613-4442-acfd-5a44bda5ef8f -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:42 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b47450-f613-4442-acfd-5a44bda5ef8f -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568
Aug 26 03:11:42 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:43 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37b47450-f613-4442-acfd-5a44bda5ef8f -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568" returned: 0 in 0.493s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:43 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 is being set with open permissions: ugo+rw
Aug 26 03:11:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:43 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568
Aug 26 03:11:43 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:43 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568" returned: 0 in 0.365s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:43 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info
Aug 26 03:11:43 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:44 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:44 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info is being set with open permissions: ugo+rw
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:44 devstack sudo[102628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info
Aug 26 03:11:44 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:44 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.info" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-744136852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9df967-1197-4223-a79c-50bf98abb85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9ced4ff63467f99751c99e668c67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:42Z,use_quota=True,user_id='47bd78ddbbaa409daa520c15bdb0bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Creating volume 4b9df967-1197-4223-a79c-50bf98abb85e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:11:44 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:11:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:44 devstack sudo[102631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e 1073741824
Aug 26 03:11:44 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-395836aa-d715-4fe5-a6f6-c424f4e4f1d4 req-5a33c109-7317-431f-80fa-12754b2ab78e tempest-VolumesSnapshotsTestJSON-1188382728 None] Create snapshot completed successfully
Aug 26 03:11:45 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e 1073741824" returned: 0 in 0.610s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:45 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e
Aug 26 03:11:45 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:45 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e" returned: 0 in 0.329s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2270ea-a135-44c3-8bfe-ddeb098a6847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9df967-1197-4223-a79c-50bf98abb85e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927881fb-54a6-4751-b463-9891807856df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Volume volume-4b9df967-1197-4223-a79c-50bf98abb85e (4b9df967-1197-4223-a79c-50bf98abb85e): created successfully
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927881fb-54a6-4751-b463-9891807856df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Flow 'volume_create_manager' (1a192a5d-3abb-4f83-ab40-6602f4e1bab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-62b1cd1c-cd48-4bac-8f8b-771c567cebc4 tempest-ServersNegativeTestJSON-1832946395 None] Created volume successfully.
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "cinder-35a9be46-f3e6-4d56-8029-39334191c568-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-35a9be46-f3e6-4d56-8029-39334191c568-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "cinder-quobyte-37b47450-f613-4442-acfd-5a44bda5ef8f" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-quobyte-37b47450-f613-4442-acfd-5a44bda5ef8f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "cinder-quobyte-35a9be46-f3e6-4d56-8029-39334191c568" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-quobyte-35a9be46-f3e6-4d56-8029-39334191c568" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Deleting offline snapshot 35a9be46-f3e6-4d56-8029-39334191c568 of volume 37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] snapshot_file for this snap is: volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b8e4b-69ba-4bac-9f62-ac975f1dde4f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:45 devstack sudo[102640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568
Aug 26 03:11:45 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:46 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568" returned: 0 in 0.461s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37b47450-f613-4442-acfd-5a44bda5ef8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465919b-8976-462e-9223-436525b87f9a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:46 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f
Aug 26 03:11:46 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:46 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f" returned: 0 in 0.532s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:46 devstack sudo[102651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568
Aug 26 03:11:46 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "cinder-4b9df967-1197-4223-a79c-50bf98abb85e-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-4b9df967-1197-4223-a79c-50bf98abb85e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "cinder-quobyte-4b9df967-1197-4223-a79c-50bf98abb85e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-quobyte-4b9df967-1197-4223-a79c-50bf98abb85e" acquired by "delete_volume" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8009ce87-6675-46de-be0f-68bb64c31083]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:47 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e
Aug 26 03:11:47 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:47 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568" returned: 0 in 0.515s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:47 devstack sudo[102659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568
Aug 26 03:11:47 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:47 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f.35a9be46-f3e6-4d56-8029-39334191c568" returned: 0 in 0.336s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:47 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e" returned: 0 in 0.545s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:47 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e
Aug 26 03:11:47 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-quobyte-35a9be46-f3e6-4d56-8029-39334191c568" released by "_delete_snapshot" :: held 2.046s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-quobyte-37b47450-f613-4442-acfd-5a44bda5ef8f" released by "delete_snapshot" :: held 2.089s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:47 devstack cinder-volume[94326]: DEBUG cinder.quota [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Created reservations ['4e95c128-2ab7-488d-9ff7-20b79459da52', '355ea59f-0324-442c-ba2e-d80c00505c7e', '3ce29eb6-4c8a-4392-a30c-24deb5b345bf', 'e9218af7-17b8-40ea-958c-8356c2d801b1'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Delete snapshot completed successfully.
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-153a1673-5049-477f-8cdf-fbce5e1474b1 req-14e70bdc-fd87-4621-941b-6a9d9113d046 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-35a9be46-f3e6-4d56-8029-39334191c568-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:48 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b9df967-1197-4223-a79c-50bf98abb85e" returned: 0 in 0.405s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-quobyte-4b9df967-1197-4223-a79c-50bf98abb85e" released by "delete_volume" :: held 1.032s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Created reservations ['7c5ca4ff-27f1-4309-9c14-443fe711d734', '59aa3410-d7ae-4705-8e64-d76152cb9dd6', 'b3590fde-7d5a-424b-a11b-9549c939bedd', '0c531d41-72d8-4dff-9f10-4e64780a858b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:48 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:48 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:48 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Deleted volume successfully.
Aug 26 03:11:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2a8e2cbb-305c-4b93-91c2-06649865db77 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-4b9df967-1197-4223-a79c-50bf98abb85e-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "cinder-37b47450-f613-4442-acfd-5a44bda5ef8f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-37b47450-f613-4442-acfd-5a44bda5ef8f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "cinder-quobyte-37b47450-f613-4442-acfd-5a44bda5ef8f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-quobyte-37b47450-f613-4442-acfd-5a44bda5ef8f" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "cinder-b26ebb14-070b-48d2-a95a-18438dcaac74-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1251596-d19f-4e58-be46-d41c462c50f4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-b26ebb14-070b-48d2-a95a-18438dcaac74-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "cinder-quobyte-b26ebb14-070b-48d2-a95a-18438dcaac74" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-quobyte-b26ebb14-070b-48d2-a95a-18438dcaac74" acquired by "delete_volume" :: waited 0.041s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be517846-f2f9-4a28-851b-5925b3a88862]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:49 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f
Aug 26 03:11:49 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:49 devstack sudo[102683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74
Aug 26 03:11:49 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:50 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f" returned: 0 in 0.646s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:50 devstack sudo[102689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f
Aug 26 03:11:50 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:50 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74" returned: 0 in 0.584s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:50 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74
Aug 26 03:11:50 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:50 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-37b47450-f613-4442-acfd-5a44bda5ef8f" returned: 0 in 0.466s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-quobyte-37b47450-f613-4442-acfd-5a44bda5ef8f" released by "delete_volume" :: held 1.236s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG cinder.quota [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Created reservations ['3a41fec3-945e-41bc-a293-3faa4e8b6b65', '3fcec294-9352-4d44-b65d-5773e39daa56', '46a1ec82-a378-45e0-a610-ab2d5079b7bf', '9325d14e-903a-4c8d-8448-6c7e97a904bf'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:50 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b26ebb14-070b-48d2-a95a-18438dcaac74" returned: 0 in 0.507s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-quobyte-b26ebb14-070b-48d2-a95a-18438dcaac74" released by "delete_volume" :: held 1.171s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:50 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:50 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Created reservations ['6dbcca23-4afd-4dd3-ad87-dbde6db32456', '8a65fe6d-0369-4acb-bc79-046e9406d789', '76422781-00a9-4f61-acd3-0d09f374b44b', '4ae92ae4-c71f-4553-8cd4-a551e1136497'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:51 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:11:51 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:51 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.463s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG cinder.manager [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:51 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Deleted volume successfully.
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-e880410b-ef4d-4acf-bb99-50eabba3b87f req-ece06830-6dac-4af1-8416-2efcd1a4b648 tempest-VolumesSnapshotsTestJSON-1188382728 None] Lock "cinder-37b47450-f613-4442-acfd-5a44bda5ef8f-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:51 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.322s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:11:51 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Deleted volume successfully.
Aug 26 03:11:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-827bdd4c-c1b9-4f84-a80a-e21bc5e0e070 tempest-ServersNegativeTestJSON-1832946395 None] Lock "cinder-b26ebb14-070b-48d2-a95a-18438dcaac74-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (2eac148d-f4dd-4b91-a1ac-274f62680059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b896e22-ea0c-4280-9e61-b348428b7bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b896e22-ea0c-4280-9e61-b348428b7bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2147109915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3927c955-022b-4202-a421-3e38adac9214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:55Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82481495-e478-4cdd-9961-71a925845ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82481495-e478-4cdd-9961-71a925845ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a2a3a9-112a-4401-8ed3-d299d8dfed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a2a3a9-112a-4401-8ed3-d299d8dfed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3927c955-022b-4202-a421-3e38adac9214', 'volume_name': 'volume-3927c955-022b-4202-a421-3e38adac9214', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f449938b-82b6-4388-994c-121aec7bd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f449938b-82b6-4388-994c-121aec7bd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe5c61b-be9b-4b11-aebe-87f67a3a3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Volume 3927c955-022b-4202-a421-3e38adac9214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3927c955-022b-4202-a421-3e38adac9214', 'volume_size': 1}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2147109915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3927c955-022b-4202-a421-3e38adac9214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:55Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Creating volume 3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:11:55 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:55 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 1073741824
Aug 26 03:11:55 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:55 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 1073741824" returned: 0 in 0.687s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:55 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214
Aug 26 03:11:55 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:56 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214" returned: 0 in 0.410s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe5c61b-be9b-4b11-aebe-87f67a3a3617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3927c955-022b-4202-a421-3e38adac9214', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51203ff-59b8-4cd9-845c-ef5476d0a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:11:56 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Volume volume-3927c955-022b-4202-a421-3e38adac9214 (3927c955-022b-4202-a421-3e38adac9214): created successfully
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51203ff-59b8-4cd9-845c-ef5476d0a591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:11:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (2eac148d-f4dd-4b91-a1ac-274f62680059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:11:56 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1fde4c05-1600-4c30-b076-0a2ef00002fb tempest-VolumesSnapshotTestJSON-140406682 None] Created volume successfully.
Aug 26 03:11:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:11:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:11:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Creating offline snapshot edb11dca-b29e-413f-98a0-7e1aa23ccd0b of volume 3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:11:57 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb899ac-01b3-465a-86e3-e24fda77b025]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:11:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:58 devstack sudo[102814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214
Aug 26 03:11:58 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:58 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214" returned: 0 in 0.651s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:58 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b 1G
Aug 26 03:11:58 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:59 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b 1G" returned: 0 in 0.753s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3927c955-022b-4202-a421-3e38adac9214 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:59 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3927c955-022b-4202-a421-3e38adac9214 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b
Aug 26 03:11:59 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:11:59 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Aug 26 03:11:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3927c955-022b-4202-a421-3e38adac9214 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:11:59 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b is being set with open permissions: ugo+rw
Aug 26 03:11:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:11:59 devstack sudo[102860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b
Aug 26 03:11:59 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:00 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b" returned: 0 in 0.460s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:00 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info
Aug 26 03:12:00 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Flow 'volume_create_manager' (174690dc-d14f-4577-8fe7-92996aabd571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e66582e-5d93-4962-b70c-777898b43f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e66582e-5d93-4962-b70c-777898b43f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2020422285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d010b98-8e53-4451-a78e-93a27c769b67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5900087d095944449ad608b351acf90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:00Z,use_quota=True,user_id='54a2537037a14af3ab8f654a0e62e6b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c84b20-aa72-4a86-99ef-32576d4da541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c84b20-aa72-4a86-99ef-32576d4da541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e00073-131b-49c6-aab2-94b49d14539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e00073-131b-49c6-aab2-94b49d14539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d010b98-8e53-4451-a78e-93a27c769b67', 'volume_name': 'volume-9d010b98-8e53-4451-a78e-93a27c769b67', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80315dd-4d1c-4001-971f-ce27836c6586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80315dd-4d1c-4001-971f-ce27836c6586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac548b9-7823-4603-9b27-97f222b1c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Volume 9d010b98-8e53-4451-a78e-93a27c769b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d010b98-8e53-4451-a78e-93a27c769b67', 'volume_size': 1}
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:00 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info" returned: 0 in 0.431s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:00 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info is being set with open permissions: ugo+rw
Aug 26 03:12:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:00 devstack sudo[102869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info
Aug 26 03:12:00 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:01 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.info" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.332s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2020422285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d010b98-8e53-4451-a78e-93a27c769b67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5900087d095944449ad608b351acf90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:00Z,use_quota=True,user_id='54a2537037a14af3ab8f654a0e62e6b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Creating volume 9d010b98-8e53-4451-a78e-93a27c769b67 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:01 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:01 devstack sudo[102872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67 1073741824
Aug 26 03:12:01 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7ed49c1c-1297-4358-8d13-8ce588bca3a2 tempest-VolumesSnapshotTestJSON-140406682 None] Create snapshot completed successfully
Aug 26 03:12:01 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67 1073741824" returned: 0 in 0.584s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:01 devstack sudo[102878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67
Aug 26 03:12:01 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:02 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67" returned: 0 in 0.477s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac548b9-7823-4603-9b27-97f222b1c71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d010b98-8e53-4451-a78e-93a27c769b67', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623edd6d-3689-44f3-9b56-0fdad8e6eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:02 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Volume volume-9d010b98-8e53-4451-a78e-93a27c769b67 (9d010b98-8e53-4451-a78e-93a27c769b67): created successfully
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623edd6d-3689-44f3-9b56-0fdad8e6eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Flow 'volume_create_manager' (174690dc-d14f-4577-8fe7-92996aabd571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2ecf5ca1-3837-4c56-8956-4f251c2cbfd3 tempest-VolumesTestJSON-1525960015 None] Created volume successfully.
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-edb11dca-b29e-413f-98a0-7e1aa23ccd0b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-edb11dca-b29e-413f-98a0-7e1aa23ccd0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-3927c955-022b-4202-a421-3e38adac9214" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-3927c955-022b-4202-a421-3e38adac9214" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-edb11dca-b29e-413f-98a0-7e1aa23ccd0b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-edb11dca-b29e-413f-98a0-7e1aa23ccd0b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Deleting offline snapshot edb11dca-b29e-413f-98a0-7e1aa23ccd0b of volume 3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] snapshot_file for this snap is: volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c17329-e00f-47c5-bcaa-8cefcb8ffbfd]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:02 devstack sudo[102881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b
Aug 26 03:12:02 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:03 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b" returned: 0 in 0.520s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3927c955-022b-4202-a421-3e38adac9214(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:12:03 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc1205-d96e-4063-9aca-18e2aae7078a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:03 devstack sudo[102886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214
Aug 26 03:12:03 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:03 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214" returned: 0 in 0.531s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:03 devstack sudo[102893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b
Aug 26 03:12:03 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:04 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b" returned: 0 in 0.553s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:04 devstack sudo[102899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b
Aug 26 03:12:04 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Flow 'volume_create_manager' (b79edb74-ec82-44ad-90c4-dc8f6fca20b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb18784-c756-42f9-a3e9-a1354ddcbe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb18784-c756-42f9-a3e9-a1354ddcbe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1757289680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd8c608-0a92-42cc-b6be-670eb243e33e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5900087d095944449ad608b351acf90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:04Z,use_quota=True,user_id='54a2537037a14af3ab8f654a0e62e6b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e610fe6-010d-41be-893d-0757f0c35b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e610fe6-010d-41be-893d-0757f0c35b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52bf17d-d404-4316-900b-32ea5400f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52bf17d-d404-4316-900b-32ea5400f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd8c608-0a92-42cc-b6be-670eb243e33e', 'volume_name': 'volume-6dd8c608-0a92-42cc-b6be-670eb243e33e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1708a0-fe4d-454a-9410-18379a89997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1708a0-fe4d-454a-9410-18379a89997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4854f15e-ddec-4ccc-b0d7-9871e2b27486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:04 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Volume 6dd8c608-0a92-42cc-b6be-670eb243e33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd8c608-0a92-42cc-b6be-670eb243e33e', 'volume_size': 1}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1757289680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd8c608-0a92-42cc-b6be-670eb243e33e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5900087d095944449ad608b351acf90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:04Z,use_quota=True,user_id='54a2537037a14af3ab8f654a0e62e6b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Creating volume 6dd8c608-0a92-42cc-b6be-670eb243e33e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:04 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:04 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e 1073741824
Aug 26 03:12:04 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:05 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214.edb11dca-b29e-413f-98a0-7e1aa23ccd0b" returned: 0 in 0.667s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-edb11dca-b29e-413f-98a0-7e1aa23ccd0b" released by "_delete_snapshot" :: held 2.492s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-3927c955-022b-4202-a421-3e38adac9214" released by "delete_snapshot" :: held 2.532s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['037170f8-626a-47a8-b290-ffe51c3cb7a5', '350c87c6-fe3a-4965-9b63-745aa9aed9d0', '3cdfe10b-d7e4-4b62-9ce7-02bd619fc25b', 'ee1a4dec-4497-4f75-9e62-71b9d023ea2c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:05 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e 1073741824" returned: 0 in 0.915s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Delete snapshot completed successfully.
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0d55982-3e31-4f14-a3a9-e3c6069395ee tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-edb11dca-b29e-413f-98a0-7e1aa23ccd0b-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:05 devstack sudo[102908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e
Aug 26 03:12:05 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:05 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e" returned: 0 in 0.287s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4854f15e-ddec-4ccc-b0d7-9871e2b27486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd8c608-0a92-42cc-b6be-670eb243e33e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ab8c63-a662-49a4-8741-e9f91983bb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Volume volume-6dd8c608-0a92-42cc-b6be-670eb243e33e (6dd8c608-0a92-42cc-b6be-670eb243e33e): created successfully
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ab8c63-a662-49a4-8741-e9f91983bb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Flow 'volume_create_manager' (b79edb74-ec82-44ad-90c4-dc8f6fca20b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6ea3e333-afa1-4248-a23e-91df82435fd8 tempest-VolumesTestJSON-1525960015 None] Created volume successfully.
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (c4ac31ed-1a8d-497f-9fcc-bef16ec48354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b12d9c-e367-4beb-9e51-4a61ab3f9f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b12d9c-e367-4beb-9e51-4a61ab3f9f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1345044252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d4bbba-5156-4c5a-bf2e-80f3af196aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:07Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b639c17-e6f6-4bb1-bd38-db97b11b3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b639c17-e6f6-4bb1-bd38-db97b11b3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5716c70b-71e4-4a74-a3d9-ed4fcf49f19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5716c70b-71e4-4a74-a3d9-ed4fcf49f19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d4bbba-5156-4c5a-bf2e-80f3af196aca', 'volume_name': 'volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0ed0ae-0cf4-440c-bcdd-65708b8df620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0ed0ae-0cf4-440c-bcdd-65708b8df620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50ffd04-b0bd-4e55-b4a3-7786eba9d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:06 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Volume 60d4bbba-5156-4c5a-bf2e-80f3af196aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca', 'volume_size': 1}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1345044252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d4bbba-5156-4c5a-bf2e-80f3af196aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:07Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Creating volume 60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:06 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:06 devstack sudo[102912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca 1073741824
Aug 26 03:12:06 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Flow 'volume_create_manager' (5818b2bb-5b8e-44f9-a877-88de1064d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:07 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d395849-f25d-47d7-8673-cd06ab26593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca 1073741824" returned: 0 in 0.799s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d395849-f25d-47d7-8673-cd06ab26593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-187141214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accfe740-1068-4d05-bc8e-0544e9637420,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5900087d095944449ad608b351acf90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:07Z,use_quota=True,user_id='54a2537037a14af3ab8f654a0e62e6b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e991b6-f271-401e-91a5-9c69d5a059b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e991b6-f271-401e-91a5-9c69d5a059b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9763bb78-0547-41a3-9134-6a967d280d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9763bb78-0547-41a3-9134-6a967d280d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accfe740-1068-4d05-bc8e-0544e9637420', 'volume_name': 'volume-accfe740-1068-4d05-bc8e-0544e9637420', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231c9475-5d0f-4def-ae89-45d4c190b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231c9475-5d0f-4def-ae89-45d4c190b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75543c1c-ce94-4688-ba88-4bd068356b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:07 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Volume accfe740-1068-4d05-bc8e-0544e9637420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accfe740-1068-4d05-bc8e-0544e9637420', 'volume_size': 1}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:07 devstack sudo[102918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca
Aug 26 03:12:07 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:08 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca" returned: 0 in 0.273s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-187141214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accfe740-1068-4d05-bc8e-0544e9637420,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5900087d095944449ad608b351acf90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:07Z,use_quota=True,user_id='54a2537037a14af3ab8f654a0e62e6b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Creating volume accfe740-1068-4d05-bc8e-0544e9637420 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:08 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50ffd04-b0bd-4e55-b4a3-7786eba9d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:08 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420 1073741824
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0027e59c-b4b8-46d0-b3a7-d3b6c72fc768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:08 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Volume volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca (60d4bbba-5156-4c5a-bf2e-80f3af196aca): created successfully
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0027e59c-b4b8-46d0-b3a7-d3b6c72fc768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (c4ac31ed-1a8d-497f-9fcc-bef16ec48354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e26ca0de-42d9-46ee-ad56-910843163655 tempest-VolumesSnapshotTestJSON-140406682 None] Created volume successfully.
Aug 26 03:12:08 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420 1073741824" returned: 0 in 0.580s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:08 devstack sudo[102929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420
Aug 26 03:12:08 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:09 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420" returned: 0 in 0.461s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.043s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75543c1c-ce94-4688-ba88-4bd068356b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accfe740-1068-4d05-bc8e-0544e9637420', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f88e4a-b49d-434d-96d7-9d887f74bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Creating offline snapshot 51267796-db4a-4e57-a166-13883003d8ee of volume 60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:12:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Volume volume-accfe740-1068-4d05-bc8e-0544e9637420 (accfe740-1068-4d05-bc8e-0544e9637420): created successfully
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f88e4a-b49d-434d-96d7-9d887f74bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Flow 'volume_create_manager' (5818b2bb-5b8e-44f9-a877-88de1064d907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84753c66-9df9-4cce-bad3-231f1f55edbe]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ddc9a737-33e9-4f23-8bb7-10367fbcc167 tempest-VolumesTestJSON-1525960015 None] Created volume successfully.
Aug 26 03:12:09 devstack sudo[102932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca
Aug 26 03:12:09 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:09 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca" returned: 0 in 0.590s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:09 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee 1G
Aug 26 03:12:09 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:10 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee 1G" returned: 0 in 0.631s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:10 devstack sudo[102943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee
Aug 26 03:12:10 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:10 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee" returned: 0 in 0.468s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:10 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee is being set with open permissions: ugo+rw
Aug 26 03:12:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:10 devstack sudo[102948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee
Aug 26 03:12:10 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "cinder-accfe740-1068-4d05-bc8e-0544e9637420-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-accfe740-1068-4d05-bc8e-0544e9637420-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "cinder-quobyte-accfe740-1068-4d05-bc8e-0544e9637420" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-quobyte-accfe740-1068-4d05-bc8e-0544e9637420" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d346bbd5-8767-4bdd-b9ef-60a1d260f2fd]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:11 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420
Aug 26 03:12:11 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:11 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee" returned: 0 in 0.628s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:11 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info
Aug 26 03:12:11 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:11 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420" returned: 0 in 0.613s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:11 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420
Aug 26 03:12:11 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:11 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info" returned: 0 in 0.356s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:11 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info is being set with open permissions: ugo+rw
Aug 26 03:12:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:11 devstack sudo[102962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info
Aug 26 03:12:11 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:12 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-accfe740-1068-4d05-bc8e-0544e9637420" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-quobyte-accfe740-1068-4d05-bc8e-0544e9637420" released by "delete_volume" :: held 0.961s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Created reservations ['c3c23d7e-ccc6-48c3-97cf-407b98a52c30', 'f6caf6dc-16e3-4cfa-ae41-4f1b458ff8d1', '102ce13c-3c79-4a80-97f1-1c6ae5c07ca6', 'a5ddb055-a9d1-495f-a543-e9b1e81f4690'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:12 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.info" returned: 0 in 0.381s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2ef24013-0f85-4606-b982-fb0d5f79748b tempest-VolumesSnapshotTestJSON-140406682 None] Create snapshot completed successfully
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Acquiring lock "cinder-6dd8c608-0a92-42cc-b6be-670eb243e33e-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:12 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:12 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Lock "cinder-6dd8c608-0a92-42cc-b6be-670eb243e33e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Acquiring lock "cinder-quobyte-6dd8c608-0a92-42cc-b6be-670eb243e33e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:12 devstack sudo[102968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:12 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Lock "cinder-quobyte-6dd8c608-0a92-42cc-b6be-670eb243e33e" acquired by "delete_volume" :: waited 0.053s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdb1ae1-56ea-437d-952c-e56b3018d562]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:12 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.414s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Deleted volume successfully.
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-53719d2a-18fc-4bf8-adeb-681fa1658271 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-accfe740-1068-4d05-bc8e-0544e9637420-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:12 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e
Aug 26 03:12:12 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:12 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.405s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:12:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:12:13 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e" returned: 0 in 0.543s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:13 devstack sudo[102993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e
Aug 26 03:12:13 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:13 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6dd8c608-0a92-42cc-b6be-670eb243e33e" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Lock "cinder-quobyte-6dd8c608-0a92-42cc-b6be-670eb243e33e" released by "delete_volume" :: held 0.915s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Created reservations ['97da2e98-b40a-494d-bb8b-9b6e49d787d4', 'bc8d6095-b3a3-4571-ad8b-1e222ed6aee9', '65c7fd22-066d-4b76-97a6-855cc34000ee', '1e3eff31-378a-407b-a17d-278a50fec9cf'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:13 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:13 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "cinder-9d010b98-8e53-4451-a78e-93a27c769b67-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-9d010b98-8e53-4451-a78e-93a27c769b67-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "cinder-quobyte-9d010b98-8e53-4451-a78e-93a27c769b67" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-quobyte-9d010b98-8e53-4451-a78e-93a27c769b67" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d817f143-f371-4c56-983e-be01f75772e5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:14 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:14 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67
Aug 26 03:12:14 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Deleted volume successfully.
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb8f471f-6014-4045-b111-eb8a36a189da tempest-VolumesTestJSON-1525960015 None] Lock "cinder-6dd8c608-0a92-42cc-b6be-670eb243e33e-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (5fb215a7-1c91-4792-9fdf-dc2453be2efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673833ff-e07f-4de6-aec9-42486171a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673833ff-e07f-4de6-aec9-42486171a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-176291832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2395238f-576e-454a-b85c-969004279cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=51267796-db4a-4e57-a166-13883003d8ee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:14Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30df2103-3020-43ce-b4ea-20f2e6613e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30df2103-3020-43ce-b4ea-20f2e6613e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc29fbd-9358-4595-85c3-d9b390d85174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc29fbd-9358-4595-85c3-d9b390d85174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2395238f-576e-454a-b85c-969004279cc5', 'volume_name': 'volume-2395238f-576e-454a-b85c-969004279cc5', 'volume_size': 2, 'snapshot_id': '51267796-db4a-4e57-a166-13883003d8ee'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa831741-5d61-4d58-92e2-8e3c094c4c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa831741-5d61-4d58-92e2-8e3c094c4c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd73008-26a4-415f-90ca-0e86eb98a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Volume 2395238f-576e-454a-b85c-969004279cc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2395238f-576e-454a-b85c-969004279cc5', 'volume_size': 2, 'snapshot_id': '51267796-db4a-4e57-a166-13883003d8ee'}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-51267796-db4a-4e57-a166-13883003d8ee-2395238f-576e-454a-b85c-969004279cc5" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-51267796-db4a-4e57-a166-13883003d8ee-2395238f-576e-454a-b85c-969004279cc5" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Creating volume 2395238f-576e-454a-b85c-969004279cc5 from snapshot 51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-2395238f-576e-454a-b85c-969004279cc5" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:14 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67" returned: 0 in 0.389s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2395238f-576e-454a-b85c-969004279cc5" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] snapshot: 51267796-db4a-4e57-a166-13883003d8ee, volume: 2395238f-576e-454a-b85c-969004279cc5,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:12:14 devstack sudo[103006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67
Aug 26 03:12:14 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f8564d-aa53-469d-828b-c709b69ab32e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:14 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee
Aug 26 03:12:14 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:14 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d010b98-8e53-4451-a78e-93a27c769b67" returned: 0 in 0.270s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-quobyte-9d010b98-8e53-4451-a78e-93a27c769b67" released by "delete_volume" :: held 0.753s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Created reservations ['f075248d-4d27-4b1b-b663-f4bb27dd698f', '559a5f17-532b-4fd4-b422-44fe61307ede', '910eeab6-0ca4-4d01-84e4-98810eddf837', '7e9aeb1f-b805-4d62-840f-4ba0b4d7bad7'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:14 devstack sudo[103014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:14 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:14 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f29b490-17bf-4627-97a6-c9948fc612a7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:14 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca
Aug 26 03:12:14 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:15 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Deleted volume successfully.
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-072ab002-d722-4d53-b0d0-573db5613ee1 tempest-VolumesTestJSON-1525960015 None] Lock "cinder-9d010b98-8e53-4451-a78e-93a27c769b67-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:15 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca" returned: 0 in 0.496s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:12:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:15 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5
Aug 26 03:12:15 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:21 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5" returned: 0 in 5.828s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:12:21 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Converted 1024.00 MB image at 175.67 MB/s
Aug 26 03:12:21 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 is being set with open permissions: ugo+rw
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:21 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5
Aug 26 03:12:21 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:21 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2395238f-576e-454a-b85c-969004279cc5" released by "_copy_volume_from_snapshot" :: held 7.279s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-51267796-db4a-4e57-a166-13883003d8ee-2395238f-576e-454a-b85c-969004279cc5" released by "_create_volume_from_snapshot" :: held 7.397s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.418s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd73008-26a4-415f-90ca-0e86eb98a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2395238f-576e-454a-b85c-969004279cc5', 'volume_size': 2, 'snapshot_id': '51267796-db4a-4e57-a166-13883003d8ee'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd11f7c0-f50f-4d85-973c-1115b370e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Volume volume-2395238f-576e-454a-b85c-969004279cc5 (2395238f-576e-454a-b85c-969004279cc5): created successfully
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd11f7c0-f50f-4d85-973c-1115b370e847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (5fb215a7-1c91-4792-9fdf-dc2453be2efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-34f323da-d983-48c4-ac14-cd4f9fd185ac tempest-VolumesSnapshotTestJSON-140406682 None] Created volume successfully.
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-2395238f-576e-454a-b85c-969004279cc5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-2395238f-576e-454a-b85c-969004279cc5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-2395238f-576e-454a-b85c-969004279cc5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2395238f-576e-454a-b85c-969004279cc5" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-88acac68-5f7d-4d19-9691-bf07f866842b tempest-BackendsCapabilitiesAdminTestsJSON-1458591402 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6434135437012, 'free_capacity_gb': 1774.6434135437012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94326) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b769621-d8af-4558-ae91-e7665dfc2f3b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-95bce964-0e6c-481c-9d1a-b41611db884b tempest-BackendsCapabilitiesAdminTestsJSON-1458591402 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6434135437012, 'free_capacity_gb': 1774.6434135437012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94326) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 26 03:12:22 devstack sudo[103041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5
Aug 26 03:12:22 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:23 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5" returned: 0 in 0.554s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:23 devstack sudo[103046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5
Aug 26 03:12:23 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:23 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2395238f-576e-454a-b85c-969004279cc5" returned: 0 in 0.307s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2395238f-576e-454a-b85c-969004279cc5" released by "delete_volume" :: held 0.932s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['4324b639-5c78-44dc-8121-c13b82d33bad', 'f2080915-a6b0-42cd-9adb-34306c23c973', '3c40b3a6-9ffe-469b-b76a-aa76aa524134', '42d93823-70a6-4842-b2b6-30a0070c83de'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:23 devstack sudo[103051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:23 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:24 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.472s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Deleted volume successfully.
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b4d09634-a7f9-4dfa-8648-353c7710441d tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-2395238f-576e-454a-b85c-969004279cc5-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Flow 'volume_create_manager' (dfdc30ef-b483-48d9-a718-d10b134b2141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119c776b-b137-482f-a386-9df752ac5ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119c776b-b137-482f-a386-9df752ac5ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-373018637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295d4e18-e786-4176-a3a9-6242a6c452db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babc352414c04b83b3509231fa7b140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='15ec8f26dd8f48e0b0bb54c0ea14d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4bf74a-d0eb-4f18-89b8-7373c12971a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4bf74a-d0eb-4f18-89b8-7373c12971a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2cfafd-98fb-483a-960f-ecf62acb1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2cfafd-98fb-483a-960f-ecf62acb1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295d4e18-e786-4176-a3a9-6242a6c452db', 'volume_name': 'volume-295d4e18-e786-4176-a3a9-6242a6c452db', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14151b3d-7799-420f-b4c6-e524e392c35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14151b3d-7799-420f-b4c6-e524e392c35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297b44cb-3b7c-4e36-997b-097911ae8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:24 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Volume 295d4e18-e786-4176-a3a9-6242a6c452db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295d4e18-e786-4176-a3a9-6242a6c452db', 'volume_size': 1}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-373018637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295d4e18-e786-4176-a3a9-6242a6c452db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babc352414c04b83b3509231fa7b140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='15ec8f26dd8f48e0b0bb54c0ea14d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Creating volume 295d4e18-e786-4176-a3a9-6242a6c452db {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:24 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-51267796-db4a-4e57-a166-13883003d8ee-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:24 devstack sudo[103056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db 1073741824
Aug 26 03:12:24 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-51267796-db4a-4e57-a166-13883003d8ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-60d4bbba-5156-4c5a-bf2e-80f3af196aca" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-60d4bbba-5156-4c5a-bf2e-80f3af196aca" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-51267796-db4a-4e57-a166-13883003d8ee" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-51267796-db4a-4e57-a166-13883003d8ee" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Deleting offline snapshot 51267796-db4a-4e57-a166-13883003d8ee of volume 60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] snapshot_file for this snap is: volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc253201-b41c-4274-8f07-05aefa93e2bf]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:25 devstack sudo[103058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee
Aug 26 03:12:25 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:25 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db 1073741824" returned: 0 in 0.653s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:25 devstack sudo[103067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee" returned: 0 in 0.642s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:12:25 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:25 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c98226a-fc20-4b1b-8bfc-21f7cdd17489]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:25 devstack sudo[103069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca
Aug 26 03:12:25 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:25 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db" returned: 0 in 0.397s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297b44cb-3b7c-4e36-997b-097911ae8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295d4e18-e786-4176-a3a9-6242a6c452db', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732cac18-9e12-4299-b546-4a6359604a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:25 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Volume volume-295d4e18-e786-4176-a3a9-6242a6c452db (295d4e18-e786-4176-a3a9-6242a6c452db): created successfully
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732cac18-9e12-4299-b546-4a6359604a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Flow 'volume_create_manager' (dfdc30ef-b483-48d9-a718-d10b134b2141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:26 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-cea99beb-e5cb-409c-84ad-37f07edcabdb tempest-AttachVolumeTestJSON-2052491606 None] Created volume successfully.
Aug 26 03:12:26 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca" returned: 0 in 0.709s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:26 devstack sudo[103075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee
Aug 26 03:12:26 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:26 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee" returned: 0 in 0.519s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:26 devstack sudo[103080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee
Aug 26 03:12:26 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:27 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca.51267796-db4a-4e57-a166-13883003d8ee" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-51267796-db4a-4e57-a166-13883003d8ee" released by "_delete_snapshot" :: held 2.472s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-60d4bbba-5156-4c5a-bf2e-80f3af196aca" released by "delete_snapshot" :: held 2.508s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:27 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['0798a377-86e0-4d1f-ab1a-555eae20dba7', '334b89f6-d49b-4b97-b43b-3cc59bbda616', '903a4c9d-1d30-400d-8b25-abf222f88cb4', '834802a9-8be2-49b5-ba72-a78a1783b750'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Delete snapshot completed successfully.
Aug 26 03:12:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d74b842e-467c-4c1c-9914-308a2722fa88 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-51267796-db4a-4e57-a166-13883003d8ee-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-dacb1175-949d-4c14-999e-dc47dfa8b969 req-0d15e440-12a4-472b-b948-56bd172aa141 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-dacb1175-949d-4c14-999e-dc47dfa8b969 req-0d15e440-12a4-472b-b948-56bd172aa141 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-dacb1175-949d-4c14-999e-dc47dfa8b969 req-0d15e440-12a4-472b-b948-56bd172aa141 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-dacb1175-949d-4c14-999e-dc47dfa8b969 req-0d15e440-12a4-472b-b948-56bd172aa141 tempest-AttachVolumeTestJSON-2052491606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-295d4e18-e786-4176-a3a9-6242a6c452db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '781d47c6-0977-4771-a04b-69ac6579f386', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-60d4bbba-5156-4c5a-bf2e-80f3af196aca-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-60d4bbba-5156-4c5a-bf2e-80f3af196aca-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-60d4bbba-5156-4c5a-bf2e-80f3af196aca" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-dacb1175-949d-4c14-999e-dc47dfa8b969 req-0d15e440-12a4-472b-b948-56bd172aa141 tempest-AttachVolumeTestJSON-2052491606 None] attachment_update completed successfully.
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-60d4bbba-5156-4c5a-bf2e-80f3af196aca" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fbc6b2-c54e-42d8-88ed-19b488b2ef21]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:28 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca
Aug 26 03:12:28 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:28 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca" returned: 0 in 0.461s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:28 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca
Aug 26 03:12:28 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:29 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-60d4bbba-5156-4c5a-bf2e-80f3af196aca" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-60d4bbba-5156-4c5a-bf2e-80f3af196aca" released by "delete_volume" :: held 0.914s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['ed829947-802a-44c9-9b0f-3eb5f2a8839c', '7658a388-8171-4bb4-87c5-5eb01a71a729', '65f1a6f7-decb-403a-8928-43c54852bac7', '74c136da-27c7-44c2-93bb-4b5184fa1d37'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:29 devstack sudo[103490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:29 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:29 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Deleted volume successfully.
Aug 26 03:12:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e69ab7e1-af33-455e-8c4e-6d4c63b41bf9 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-60d4bbba-5156-4c5a-bf2e-80f3af196aca-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a906b8b3-3e7f-4465-86a9-7f8c97534d6c tempest-GroupSnapshotsTest-1464659339 None] Group tempest-GroupSnapshotsTest-Group-432031073: creating
Aug 26 03:12:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a906b8b3-3e7f-4465-86a9-7f8c97534d6c tempest-GroupSnapshotsTest-1464659339 None] Group tempest-GroupSnapshotsTest-Group-432031073: created successfully
Aug 26 03:12:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a906b8b3-3e7f-4465-86a9-7f8c97534d6c tempest-GroupSnapshotsTest-1464659339 None] Create group completed successfully.
Aug 26 03:12:30 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Flow 'volume_create_manager' (22910362-6868-4307-80b5-3fa791b28494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc93af7f-a045-49ae-9cc0-517768078ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc93af7f-a045-49ae-9cc0-517768078ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-530452479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babc352414c04b83b3509231fa7b140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:31Z,use_quota=True,user_id='15ec8f26dd8f48e0b0bb54c0ea14d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9796b993-cf76-42be-bea1-d7724bbe4376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9796b993-cf76-42be-bea1-d7724bbe4376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9450173-e3cd-4a6e-9e33-72ed00fd69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9450173-e3cd-4a6e-9e33-72ed00fd69da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5', 'volume_name': 'volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa9e0c-f957-4f28-a0b1-1b9b04f70fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa9e0c-f957-4f28-a0b1-1b9b04f70fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e092fa0-6f68-491e-bab6-b49d86d8019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Volume dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5', 'volume_size': 1}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-530452479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='babc352414c04b83b3509231fa7b140c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:31Z,use_quota=True,user_id='15ec8f26dd8f48e0b0bb54c0ea14d9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Creating volume dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:31 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:31 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 1073741824
Aug 26 03:12:31 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (c10c71cd-01ba-4538-8cae-78591457fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b4e81b-2d69-4b95-b86b-a70f5483c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b4e81b-2d69-4b95-b86b-a70f5483c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-944339406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45e16a8-362a-4c37-b2ee-532d5ee1f9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:31Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa6dc89-d408-44d4-adb5-dda1645ec1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa6dc89-d408-44d4-adb5-dda1645ec1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137d84b0-40dc-4bb2-98fd-fe1c86eeab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137d84b0-40dc-4bb2-98fd-fe1c86eeab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45e16a8-362a-4c37-b2ee-532d5ee1f9ac', 'volume_name': 'volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41b1a54-4ea5-42d4-b432-4e28ca0501ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41b1a54-4ea5-42d4-b432-4e28ca0501ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1218dd54-21ce-4bdc-88cb-8461b4bf7edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Volume c45e16a8-362a-4c37-b2ee-532d5ee1f9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac', 'volume_size': 1}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:31 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 1073741824" returned: 0 in 0.528s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:31 devstack sudo[103504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5
Aug 26 03:12:31 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:31 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5" returned: 0 in 0.319s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-944339406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45e16a8-362a-4c37-b2ee-532d5ee1f9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:31Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Creating volume c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:31 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e092fa0-6f68-491e-bab6-b49d86d8019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b310de2-99fe-4985-8cc1-a0d4e7ed501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:32 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac 1073741824
Aug 26 03:12:32 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Volume volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 (dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5): created successfully
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b310de2-99fe-4985-8cc1-a0d4e7ed501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Flow 'volume_create_manager' (22910362-6868-4307-80b5-3fa791b28494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-60542475-703c-4dd8-b3a5-7b0d1cd4fe24 tempest-AttachVolumeTestJSON-2052491606 None] Created volume successfully.
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (007bb716-5d79-4126-8fca-0f8d2fb37a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6712b8b-d33b-4219-9aa0-51d1598fe446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6712b8b-d33b-4219-9aa0-51d1598fe446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202117172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6ac680bd-a785-429e-85b2-d2a37d385537,host='devstack@QuobyteHD#QuobyteHD',id=4014a784-1838-42b9-9123-978b8259d7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:32Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2172e6f1-f4a9-4148-976f-8f6e88888cb9),volume_type_id=2172e6f1-f4a9-4148-976f-8f6e88888cb9)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9c5504-0e6b-4b17-936d-6ce0b06505cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9c5504-0e6b-4b17-936d-6ce0b06505cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae119f3f-e043-42bf-8d7f-67991853375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae119f3f-e043-42bf-8d7f-67991853375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4014a784-1838-42b9-9123-978b8259d7eb', 'volume_name': 'volume-4014a784-1838-42b9-9123-978b8259d7eb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f36a04-7809-4c39-ab99-694b7df9440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f36a04-7809-4c39-ab99-694b7df9440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9ddbc1-932d-4f4a-8f20-1ab469d78757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Volume 4014a784-1838-42b9-9123-978b8259d7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4014a784-1838-42b9-9123-978b8259d7eb', 'volume_size': 1}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:32 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac 1073741824" returned: 0 in 0.636s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:32 devstack sudo[103524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac
Aug 26 03:12:32 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:33 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6ac680bd-a785-429e-85b2-d2a37d385537,created_at=2026-08-26T01:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202117172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6ac680bd-a785-429e-85b2-d2a37d385537,host='devstack@QuobyteHD#QuobyteHD',id=4014a784-1838-42b9-9123-978b8259d7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:32Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2172e6f1-f4a9-4148-976f-8f6e88888cb9),volume_type_id=2172e6f1-f4a9-4148-976f-8f6e88888cb9)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Creating volume 4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:33 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1218dd54-21ce-4bdc-88cb-8461b4bf7edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f357994c-9255-4a0f-8e76-91881399032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:33 devstack sudo[103535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb 1073741824
Aug 26 03:12:33 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Volume volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac (c45e16a8-362a-4c37-b2ee-532d5ee1f9ac): created successfully
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f357994c-9255-4a0f-8e76-91881399032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (c10c71cd-01ba-4538-8cae-78591457fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-57f5dc8f-c53f-41f1-b1e6-da721ba1f799 tempest-VolumesSnapshotTestJSON-140406682 None] Created volume successfully.
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:33 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb 1073741824" returned: 0 in 0.726s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:33 devstack sudo[103552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb
Aug 26 03:12:33 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-386458cb-cdeb-4c64-b76e-78ebcb8e2508 req-ccc50205-9203-4ccc-a82d-cfe91e7a1fee tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:34 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb" returned: 0 in 0.293s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.576s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9ddbc1-932d-4f4a-8f20-1ab469d78757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4014a784-1838-42b9-9123-978b8259d7eb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a57ed1-2fd7-4b83-841c-0e4d1428e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Creating offline snapshot 2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 of volume c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:12:34 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Volume volume-4014a784-1838-42b9-9123-978b8259d7eb (4014a784-1838-42b9-9123-978b8259d7eb): created successfully
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a57ed1-2fd7-4b83-841c-0e4d1428e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (007bb716-5d79-4126-8fca-0f8d2fb37a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92440a13-ac0f-45fd-9871-00d97dc4fdc1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fd293d8b-b580-466c-b165-8360c4d0b3c6 tempest-GroupSnapshotsTest-1464659339 None] Created volume successfully.
Aug 26 03:12:34 devstack sudo[103557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac
Aug 26 03:12:34 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:34 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" returned: 0 in 0.408s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:34 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 1G
Aug 26 03:12:34 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] GroupSnapshot 410cbd32-6b98-4186-9afd-0191ff205a5e: creating.
Aug 26 03:12:35 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Group snapshot 410cbd32-6b98-4186-9afd-0191ff205a5e: creating. {{(pid=94326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 03:12:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 1G" returned: 0 in 0.538s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:35 devstack sudo[103569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63
Aug 26 03:12:35 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:35 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" returned: 0 in 0.616s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:35 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 is being set with open permissions: ugo+rw
Aug 26 03:12:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:35 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63
Aug 26 03:12:35 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:36 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" returned: 0 in 0.416s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:36 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info
Aug 26 03:12:36 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:36 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info" returned: 0 in 0.285s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:36 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info is being set with open permissions: ugo+rw
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:36 devstack sudo[103659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info
Aug 26 03:12:36 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:36 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.info" returned: 0 in 0.267s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-386458cb-cdeb-4c64-b76e-78ebcb8e2508 req-ccc50205-9203-4ccc-a82d-cfe91e7a1fee tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.805s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-386458cb-cdeb-4c64-b76e-78ebcb8e2508 req-ccc50205-9203-4ccc-a82d-cfe91e7a1fee tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.650s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-cb958825-2c4d-45ab-8bfb-d35a860bf9fd tempest-VolumesSnapshotTestJSON-140406682 None] Create snapshot completed successfully
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Creating offline snapshot 8e045b58-8535-467c-a91f-a865b9eb7097 of volume 4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-386458cb-cdeb-4c64-b76e-78ebcb8e2508 req-ccc50205-9203-4ccc-a82d-cfe91e7a1fee tempest-AttachVolumeTestJSON-2052491606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a69163f8-1b37-4aa6-835d-08cab7ae26de', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9d7873-7f14-485b-823d-5ac10bb19f6a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-386458cb-cdeb-4c64-b76e-78ebcb8e2508 req-ccc50205-9203-4ccc-a82d-cfe91e7a1fee tempest-AttachVolumeTestJSON-2052491606 None] attachment_update completed successfully.
Aug 26 03:12:37 devstack sudo[103665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb
Aug 26 03:12:37 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:37 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb" returned: 0 in 0.445s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:37 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 1G
Aug 26 03:12:37 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:38 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 1G" returned: 0 in 0.853s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4014a784-1838-42b9-9123-978b8259d7eb -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:38 devstack sudo[103683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4014a784-1838-42b9-9123-978b8259d7eb -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097
Aug 26 03:12:38 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:38 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4014a784-1838-42b9-9123-978b8259d7eb -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097" returned: 0 in 0.561s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:38 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=123,cinder:DELETE=15,cinder:INSERT=30,cinder:SELECT=124 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:12:38 devstack sudo[103726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097
Aug 26 03:12:38 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=117,cinder:UPDATE=137,cinder:INSERT=31,cinder:DELETE=10 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:12:38 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (961792b5-6afc-4ae7-aae2-4f072a549762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf02088c-d564-4ab7-8eeb-dcf3d3de80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf02088c-d564-4ab7-8eeb-dcf3d3de80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-211010733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92df62f-4f4b-4d9f-841e-114bab5aa44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd801fc06c74fefac9d92f17eaf59f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:39Z,use_quota=True,user_id='5579fd72e80147d4bbcedd22c0a68aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206e2223-53c0-47f6-b272-669e8da4dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206e2223-53c0-47f6-b272-669e8da4dd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed61316-a5e6-49ff-b3f3-f42778648fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed61316-a5e6-49ff-b3f3-f42778648fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e92df62f-4f4b-4d9f-841e-114bab5aa44b', 'volume_name': 'volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b', 'volume_size': 1, 'snapshot_id': '2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924f9e7f-3d09-4f60-8b34-f88c5b49e76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924f9e7f-3d09-4f60-8b34-f88c5b49e76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8b9d62-574a-481f-92ce-070f54bce839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:39 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Volume e92df62f-4f4b-4d9f-841e-114bab5aa44b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b', 'volume_size': 1, 'snapshot_id': '2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63'}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:39 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097" returned: 0 in 0.504s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:39 devstack sudo[103731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info
Aug 26 03:12:39 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:39 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info" returned: 0 in 0.424s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:39 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:12:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:39 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info
Aug 26 03:12:39 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:40 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.info" returned: 0 in 0.426s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.164s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63-e92df62f-4f4b-4d9f-841e-114bab5aa44b" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63-e92df62f-4f4b-4d9f-841e-114bab5aa44b" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Creating volume e92df62f-4f4b-4d9f-841e-114bab5aa44b from snapshot 2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-e92df62f-4f4b-4d9f-841e-114bab5aa44b" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-e92df62f-4f4b-4d9f-841e-114bab5aa44b" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] snapshot: 2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63, volume: e92df62f-4f4b-4d9f-841e-114bab5aa44b,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1419e91e-6cef-41df-b453-b9480159f232]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-cb95d307-f152-4776-b90c-f796ba8daade req-748230fb-2265-439d-816c-eca48708beb0 tempest-AttachVolumeTestJSON-2052491606 None] Terminate volume connection completed successfully.
Aug 26 03:12:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-cb95d307-f152-4776-b90c-f796ba8daade req-748230fb-2265-439d-816c-eca48708beb0 tempest-AttachVolumeTestJSON-2052491606 None] Deleting attachment 781d47c6-0977-4771-a04b-69ac6579f386. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:12:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-294f7686-d556-4697-b78d-4207469afa38 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 410cbd32-6b98-4186-9afd-0191ff205a5e: created successfully
Aug 26 03:12:40 devstack sudo[103744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63
Aug 26 03:12:40 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:41 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" returned: 0 in 0.740s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c1f39a-78c7-4da8-b19f-88f6ae37eda1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:41 devstack sudo[103750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac
Aug 26 03:12:41 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:41 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" returned: 0 in 0.684s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:12:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:41 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b
Aug 26 03:12:41 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-6dd434b9-8db4-4de1-b98a-805ced495028 req-68735de8-79d2-4e15-9e1f-704a0425521b tempest-AttachVolumeTestJSON-2052491606 None] Terminate volume connection completed successfully.
Aug 26 03:12:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-6dd434b9-8db4-4de1-b98a-805ced495028 req-68735de8-79d2-4e15-9e1f-704a0425521b tempest-AttachVolumeTestJSON-2052491606 None] Deleting attachment a69163f8-1b37-4aa6-835d-08cab7ae26de. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:12:48 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b" returned: 0 in 6.953s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:48 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac, size 1024.00 MB, duration 6.96 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:12:48 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Converted 1024.00 MB image at 147.17 MB/s
Aug 26 03:12:48 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b is being set with open permissions: ugo+rw
Aug 26 03:12:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:48 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b
Aug 26 03:12:48 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:49 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b" returned: 0 in 0.477s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-e92df62f-4f4b-4d9f-841e-114bab5aa44b" released by "_copy_volume_from_snapshot" :: held 9.010s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63-e92df62f-4f4b-4d9f-841e-114bab5aa44b" released by "_create_volume_from_snapshot" :: held 9.145s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.206s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.308s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-8e045b58-8535-467c-a91f-a865b9eb7097-1a62413a-54d6-49db-ab3c-233475de7a4d" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-8e045b58-8535-467c-a91f-a865b9eb7097-1a62413a-54d6-49db-ab3c-233475de7a4d" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Creating volume 1a62413a-54d6-49db-ab3c-233475de7a4d from snapshot 8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-1a62413a-54d6-49db-ab3c-233475de7a4d" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8b9d62-574a-481f-92ce-070f54bce839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b', 'volume_size': 1, 'snapshot_id': '2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3f1ff4-efe3-4f94-b710-c201d02c2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-1a62413a-54d6-49db-ab3c-233475de7a4d" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] snapshot: 8e045b58-8535-467c-a91f-a865b9eb7097, volume: 1a62413a-54d6-49db-ab3c-233475de7a4d,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:12:49 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Volume volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b (e92df62f-4f4b-4d9f-841e-114bab5aa44b): created successfully
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3f1ff4-efe3-4f94-b710-c201d02c2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Flow 'volume_create_manager' (961792b5-6afc-4ae7-aae2-4f072a549762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d2b49f38-47c4-4ec1-ad43-16777d0702ab tempest-VolumesSnapshotTestJSON-140406682 None] Created volume successfully.
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d861ec64-0df1-4ca5-9f47-0074b3939c13]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:49 devstack sudo[103836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097
Aug 26 03:12:49 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:50 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097" returned: 0 in 0.676s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4014a784-1838-42b9-9123-978b8259d7eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce733cf-1eb3-4ca3-b1aa-6ceb6f1b3051]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:50 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb
Aug 26 03:12:50 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-e92df62f-4f4b-4d9f-841e-114bab5aa44b-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-e92df62f-4f4b-4d9f-841e-114bab5aa44b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-e92df62f-4f4b-4d9f-841e-114bab5aa44b" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-e92df62f-4f4b-4d9f-841e-114bab5aa44b" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d13c50-b946-4315-9182-9719602ec868]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:51 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb" returned: 0 in 0.747s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:12:51 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:12:51 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:51 devstack sudo[103869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d
Aug 26 03:12:51 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:51 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b" returned: 0 in 0.594s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:51 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b
Aug 26 03:12:51 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:52 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e92df62f-4f4b-4d9f-841e-114bab5aa44b" returned: 0 in 0.588s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-e92df62f-4f4b-4d9f-841e-114bab5aa44b" released by "delete_volume" :: held 1.298s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "cinder-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['5c232939-237d-4dea-98f9-38e0c1e49b99', 'e4cbe21c-3cb0-4955-82ef-2601c221bf06', '6013375e-9779-40c7-a8a9-b3d0a7fe5871', '4a91a303-e36a-433f-8c0c-44a0744ad416'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "cinder-quobyte-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-quobyte-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5" acquired by "delete_volume" :: waited 0.043s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe58f132-4383-4997-9ec2-9cb7cd2c265d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:52 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:52 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:52 devstack sudo[103888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5
Aug 26 03:12:52 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:53 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.767s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Deleted volume successfully.
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2779b529-1877-411e-96d9-e6f22e6dedc0 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-e92df62f-4f4b-4d9f-841e-114bab5aa44b-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Deleting offline snapshot 2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 of volume c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] snapshot_file for this snap is: volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f867c3-b0f4-40b5-91b5-db7c9f1b1be4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:53 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:53 devstack sudo[103904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63
Aug 26 03:12:53 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5" returned: 0 in 1.378s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:53 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5
Aug 26 03:12:53 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:54 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" returned: 0 in 0.793s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b42227-1cec-4e21-bf04-12fdc24ef0a9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:54 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5" returned: 0 in 0.705s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-quobyte-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5" released by "delete_volume" :: held 2.226s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:54 devstack sudo[103914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac
Aug 26 03:12:54 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Created reservations ['99ba5156-5e44-4976-8894-6be11948bb93', 'dca89082-9fe1-4476-a2ad-747167ffa65b', '581bfae1-246a-4a91-a75e-98a025dab7ca', '5e341481-1c6e-42ae-ae9d-c0d5bf71c6d1'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:55 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:55 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:55 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.493s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Deleted volume successfully.
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-868c342e-9c1e-41ce-a1fd-b1575adf4b6b tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-dbf4bb0d-aad3-4ca6-aec7-ed7809b382b5-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "cinder-295d4e18-e786-4176-a3a9-6242a6c452db-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-295d4e18-e786-4176-a3a9-6242a6c452db-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:55 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" returned: 0 in 1.456s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "cinder-quobyte-295d4e18-e786-4176-a3a9-6242a6c452db" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:56 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63
Aug 26 03:12:56 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-quobyte-295d4e18-e786-4176-a3a9-6242a6c452db" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab79826-4712-4c2c-96b4-cd1441a4cf06]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:56 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db
Aug 26 03:12:56 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:56 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db" returned: 0 in 0.606s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:56 devstack sudo[103932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db
Aug 26 03:12:56 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:56 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d" returned: 0 in 5.709s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:12:56 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Converted 1024.00 MB image at 179.32 MB/s
Aug 26 03:12:56 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:56 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" returned: 0 in 0.895s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:56 devstack sudo[103935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d
Aug 26 03:12:56 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:56 devstack sudo[103936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63
Aug 26 03:12:56 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:57 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-295d4e18-e786-4176-a3a9-6242a6c452db" returned: 0 in 0.329s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-quobyte-295d4e18-e786-4176-a3a9-6242a6c452db" released by "delete_volume" :: held 1.023s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Created reservations ['a58e36a6-1ac8-448b-a9dc-25ae2935c05a', '6fb9cf25-1534-4e1f-905d-3bc83213ee94', '88ea9ba9-461c-45f7-a19d-fac464b62505', 'b0705fde-a5fd-468f-880f-6d1ab576fb01'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:57 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d" returned: 0 in 0.322s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:57 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac.2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" returned: 0 in 0.305s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-1a62413a-54d6-49db-ab3c-233475de7a4d" released by "_copy_volume_from_snapshot" :: held 7.610s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63" released by "_delete_snapshot" :: held 3.688s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" released by "delete_snapshot" :: held 3.761s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-8e045b58-8535-467c-a91f-a865b9eb7097-1a62413a-54d6-49db-ab3c-233475de7a4d" released by "_create_volume_from_snapshot" :: held 7.775s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.816s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:57 devstack sudo[103942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:57 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['f6cd7785-48b6-4eb8-8be2-f493849354d1', '66472570-5bbf-4fa7-92c0-14b415f48793', '694478fe-7459-4b18-a01d-285ba58a5494', '1503abeb-b05a-4e16-acab-46cd7856353b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e7017388-95d7-43c2-b97c-a9455e9af5f4 tempest-GroupSnapshotsTest-1464659339 None] Create group from source-snapshot-410cbd32-6b98-4186-9afd-0191ff205a5e completed successfully.
Aug 26 03:12:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Delete snapshot completed successfully.
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-72c818b3-5dee-4612-b60d-1acbc8a3c152 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-2fe5d4f1-d419-4cf9-bf3a-25863d6f0d63-delete_snapshot" released by "delete_snapshot" :: held 3.989s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.236s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Deleted volume successfully.
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c987980-b9ff-4d1f-b045-042f0aa316b0 tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-295d4e18-e786-4176-a3a9-6242a6c452db-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72664a79-3dbf-4f78-bac1-ff1f4e701e56]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:58 devstack sudo[103945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac
Aug 26 03:12:58 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "cinder-59f71d21-6061-43d8-94a8-44f1357a6e58-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-59f71d21-6061-43d8-94a8-44f1357a6e58-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "cinder-quobyte-59f71d21-6061-43d8-94a8-44f1357a6e58" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-quobyte-59f71d21-6061-43d8-94a8-44f1357a6e58" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:58 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" returned: 0 in 0.441s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c3563b-3027-4586-ab38-8190e954c7be]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:58 devstack sudo[103950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac
Aug 26 03:12:58 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:58 devstack sudo[103951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58
Aug 26 03:12:58 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-1a62413a-54d6-49db-ab3c-233475de7a4d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-1a62413a-54d6-49db-ab3c-233475de7a4d" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[545cdfc6-5379-447f-b4f9-36174a7933b1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:58 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac" released by "delete_volume" :: held 0.893s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:58 devstack sudo[103955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d
Aug 26 03:12:58 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:58 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['a52dfac6-01be-4587-8ac9-33b1e1882233', 'ba5f1264-64e1-47ca-b946-5bbd09753e2a', '89338ec8-0064-4b38-8f95-b949c780b499', '3a554ff0-5daa-468a-8600-93b8d8903dea'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:59 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58" returned: 0 in 0.609s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:59 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:59 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:59 devstack sudo[103962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58
Aug 26 03:12:59 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-3927c955-022b-4202-a421-3e38adac9214-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-3927c955-022b-4202-a421-3e38adac9214-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "cinder-quobyte-3927c955-022b-4202-a421-3e38adac9214" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-3927c955-022b-4202-a421-3e38adac9214" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:12:59 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-59f71d21-6061-43d8-94a8-44f1357a6e58" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:59 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d" returned: 0 in 0.744s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:59 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f757e675-f872-4d69-a6c6-7486b7a6ff61]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-quobyte-59f71d21-6061-43d8-94a8-44f1357a6e58" released by "delete_volume" :: held 1.083s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:59 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d
Aug 26 03:12:59 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.463s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:12:59 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Deleted volume successfully.
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59bc68c7-9ba8-41ee-91f1-6b0c41e6c420 tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-c45e16a8-362a-4c37-b2ee-532d5ee1f9ac-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Created reservations ['fbde146f-fc73-457c-aa37-523313b9dd05', '63b80722-a96f-47ae-9a19-d4420e740447', '12e6fe7e-46e0-43e2-a141-49530fc9f846', 'b44cbdf6-9551-4437-bce2-8819220aa692'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:59 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214
Aug 26 03:12:59 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:12:59 devstack sudo[103974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:12:59 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:12:59 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1a62413a-54d6-49db-ab3c-233475de7a4d" returned: 0 in 0.322s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-1a62413a-54d6-49db-ab3c-233475de7a4d" released by "delete_volume" :: held 1.129s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['64580826-bd5c-43e4-91a9-9b92fbe1876c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:12:59 devstack cinder-volume[94326]: WARNING cinder.quota [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1509486483 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1509486483, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:12:59 devstack cinder-volume[94326]: WARNING cinder.quota [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1509486483 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1509486483, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:12:59 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['438a3aca-9fef-45d6-a43d-4b6f62dd8212', 'd013bc4e-e159-4c04-a08f-8d328847978f', '333b31dc-a74d-432d-ac58-0788335862e9', '4b684335-3ce4-468e-bb2d-2c7211ee1019'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:00 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214" returned: 0 in 0.528s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:00 devstack sudo[103981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214
Aug 26 03:13:00 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:00 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Deleted volume successfully.
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6cf0e538-570b-46a7-828e-40db770c9bab tempest-AttachVolumeTestJSON-2052491606 None] Lock "cinder-59f71d21-6061-43d8-94a8-44f1357a6e58-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:00 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:00 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:00 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3927c955-022b-4202-a421-3e38adac9214" returned: 0 in 0.295s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-quobyte-3927c955-022b-4202-a421-3e38adac9214" released by "delete_volume" :: held 0.948s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Created reservations ['92bbaf3e-53a4-44eb-a860-ddef34932d1b', '29bfe25c-0382-45fb-90a7-e04fa63832ad', 'e04460b8-eb98-4321-93f8-e1db3bb39540', '7de2f949-105d-4e6f-83cf-747dc6e8d84d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:00 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a4a1e30a-4df9-43d6-9f1c-dec99c60a175 tempest-GroupSnapshotsTest-1464659339 None] Delete group completed successfully.
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:00 devstack sudo[103987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:00 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:00 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.279s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Deleted volume successfully.
Aug 26 03:13:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4108a512-61ed-4631-baae-8d3f36ecbedb tempest-VolumesSnapshotTestJSON-140406682 None] Lock "cinder-3927c955-022b-4202-a421-3e38adac9214-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 410cbd32-6b98-4186-9afd-0191ff205a5e: deleting
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 410cbd32-6b98-4186-9afd-0191ff205a5e: deleting {{(pid=94326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-4014a784-1838-42b9-9123-978b8259d7eb" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-4014a784-1838-42b9-9123-978b8259d7eb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-8e045b58-8535-467c-a91f-a865b9eb7097" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-8e045b58-8535-467c-a91f-a865b9eb7097" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Deleting offline snapshot 8e045b58-8535-467c-a91f-a865b9eb7097 of volume 4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] snapshot_file for this snap is: volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f051e90-938c-42df-adec-5cad5ea9777f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:01 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097
Aug 26 03:13:01 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:01 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097" returned: 0 in 0.445s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4014a784-1838-42b9-9123-978b8259d7eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80f0dc5-5c7c-41bd-b460-6a13e4240350]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:02 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb
Aug 26 03:13:02 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:02 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb" returned: 0 in 0.598s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:02 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097
Aug 26 03:13:02 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:03 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097" returned: 0 in 0.466s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:03 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097
Aug 26 03:13:03 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:03 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb.8e045b58-8535-467c-a91f-a865b9eb7097" returned: 0 in 0.315s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-8e045b58-8535-467c-a91f-a865b9eb7097" released by "_delete_snapshot" :: held 1.961s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-4014a784-1838-42b9-9123-978b8259d7eb" released by "delete_snapshot" :: held 2.003s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:03 devstack cinder-volume[94326]: WARNING cinder.quota [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1509486483 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1509486483, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:03 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['ed09e838-0e6d-4832-abfe-764c44347c95', 'aff547e6-b3e3-42a8-a47d-d005314bf4da', 'a43f0a69-7601-4785-83be-29f015ea0c82', '25321542-f0bd-4a76-b098-758da43ac8fb'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0590a0da-9d59-4420-8e25-b50e7ec05564 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 410cbd32-6b98-4186-9afd-0191ff205a5e: deleted successfully
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Flow 'volume_create_manager' (b655ebdd-57b3-4c41-9032-03aeb887d15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d668d50e-6730-4bcf-ac7a-d44337e433c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d668d50e-6730-4bcf-ac7a-d44337e433c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1868104736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76179496-2208-4507-aa25-7efe9084ee5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7f79893ee4fb39dbb0a93fe1a56fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:04Z,use_quota=True,user_id='21145694fb904df188e47e6cf8b27ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4450be94-a876-451e-9121-ef4248d52b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4450be94-a876-451e-9121-ef4248d52b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bbf339-cd86-4a92-99af-941f180c9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bbf339-cd86-4a92-99af-941f180c9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76179496-2208-4507-aa25-7efe9084ee5b', 'volume_name': 'volume-76179496-2208-4507-aa25-7efe9084ee5b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0e359e-5f2d-451a-80fa-4c68df383255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0e359e-5f2d-451a-80fa-4c68df383255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77d99da-700b-47bf-925c-7f4e92054e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:04 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Volume 76179496-2208-4507-aa25-7efe9084ee5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76179496-2208-4507-aa25-7efe9084ee5b', 'volume_size': 1}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1868104736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76179496-2208-4507-aa25-7efe9084ee5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7f79893ee4fb39dbb0a93fe1a56fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:04Z,use_quota=True,user_id='21145694fb904df188e47e6cf8b27ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Creating volume 76179496-2208-4507-aa25-7efe9084ee5b {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:04 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:04 devstack sudo[104013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b 1073741824
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-4014a784-1838-42b9-9123-978b8259d7eb" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:04 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-4014a784-1838-42b9-9123-978b8259d7eb" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc4b8f-e203-483c-ad69-1dc30bc6e453]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:04 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb
Aug 26 03:13:04 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:04 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b 1073741824" returned: 0 in 0.537s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:04 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb" returned: 0 in 0.438s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:04 devstack sudo[104024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb
Aug 26 03:13:04 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:04 devstack sudo[104026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b
Aug 26 03:13:04 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:05 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4014a784-1838-42b9-9123-978b8259d7eb" returned: 0 in 0.293s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-4014a784-1838-42b9-9123-978b8259d7eb" released by "delete_volume" :: held 0.824s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:05 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77d99da-700b-47bf-925c-7f4e92054e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76179496-2208-4507-aa25-7efe9084ee5b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a429b0-0ce7-4cbb-ab7b-1e90737b87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Volume volume-76179496-2208-4507-aa25-7efe9084ee5b (76179496-2208-4507-aa25-7efe9084ee5b): created successfully
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a429b0-0ce7-4cbb-ab7b-1e90737b87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Flow 'volume_create_manager' (b655ebdd-57b3-4c41-9032-03aeb887d15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['e1680b59-63a1-49b5-837c-a082618377ae'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-302ea398-6df8-48dd-bfcc-5b002481208e tempest-AttachVolumeNegativeTest-719800185 None] Created volume successfully.
Aug 26 03:13:05 devstack cinder-volume[94326]: WARNING cinder.db.api [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1509486483']
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['31b7fa4d-9bab-4a91-9219-731e64f3a19a', '0fabc659-3a03-456c-8f32-af65626c51bb', '12508fec-cd0b-473a-9547-0dd6b7a446cb', 'b2cf0cf6-f806-400a-b9ca-7dd314bbcc88'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:05 devstack sudo[104030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:05 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:05 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.370s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:05 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-eea45817-2c90-4616-9e47-36d8e785429c tempest-GroupSnapshotsTest-1464659339 None] Delete group completed successfully.
Aug 26 03:13:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4614fe0a-26a4-461b-9747-4cbabd69ad13 tempest-GroupSnapshotsTest-1464659339 None] Group tempest-GroupSnapshotsTest-Group-1240646714: creating
Aug 26 03:13:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4614fe0a-26a4-461b-9747-4cbabd69ad13 tempest-GroupSnapshotsTest-1464659339 None] Group tempest-GroupSnapshotsTest-Group-1240646714: created successfully
Aug 26 03:13:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4614fe0a-26a4-461b-9747-4cbabd69ad13 tempest-GroupSnapshotsTest-1464659339 None] Create group completed successfully.
Aug 26 03:13:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-1e00ef72-f307-4012-a762-d5580de1cc37 req-c8312c79-f5d6-436d-a7f5-1196cec86ec9 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-1e00ef72-f307-4012-a762-d5580de1cc37 req-c8312c79-f5d6-436d-a7f5-1196cec86ec9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-1e00ef72-f307-4012-a762-d5580de1cc37 req-c8312c79-f5d6-436d-a7f5-1196cec86ec9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-1e00ef72-f307-4012-a762-d5580de1cc37 req-c8312c79-f5d6-436d-a7f5-1196cec86ec9 tempest-AttachVolumeNegativeTest-719800185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-76179496-2208-4507-aa25-7efe9084ee5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebaebc2e-0415-491b-bc7a-a294dbb0caed', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:13:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-1e00ef72-f307-4012-a762-d5580de1cc37 req-c8312c79-f5d6-436d-a7f5-1196cec86ec9 tempest-AttachVolumeNegativeTest-719800185 None] attachment_update completed successfully.
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (2efae529-3962-459d-b8ef-632ab96c2dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace87c29-5cf5-45cf-9254-92a5ba19a1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace87c29-5cf5-45cf-9254-92a5ba19a1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531747249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=576fe4d5-fcb1-4cd4-b5ea-e2cd5a610c65,host='devstack@QuobyteHD#QuobyteHD',id=a44fc5d3-c21b-4ca8-9f57-356005b87dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:08Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2af8fbd7-17de-4c75-8de9-da9661d22ab4),volume_type_id=2af8fbd7-17de-4c75-8de9-da9661d22ab4)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86fb78f2-97f6-42f7-822b-e96e30658acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86fb78f2-97f6-42f7-822b-e96e30658acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b446f28-c104-49c6-b911-a41d7f32e135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b446f28-c104-49c6-b911-a41d7f32e135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44fc5d3-c21b-4ca8-9f57-356005b87dae', 'volume_name': 'volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdbd1c2-8ff9-42e6-9973-c824885afb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdbd1c2-8ff9-42e6-9973-c824885afb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5378e7d-f598-42bc-bce0-1ac87ae18d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Volume a44fc5d3-c21b-4ca8-9f57-356005b87dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae', 'volume_size': 1}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=576fe4d5-fcb1-4cd4-b5ea-e2cd5a610c65,created_at=2026-08-26T01:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531747249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=576fe4d5-fcb1-4cd4-b5ea-e2cd5a610c65,host='devstack@QuobyteHD#QuobyteHD',id=a44fc5d3-c21b-4ca8-9f57-356005b87dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:08Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2af8fbd7-17de-4c75-8de9-da9661d22ab4),volume_type_id=2af8fbd7-17de-4c75-8de9-da9661d22ab4)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Creating volume a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:08 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:08 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae 1073741824
Aug 26 03:13:08 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:09 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae 1073741824" returned: 0 in 0.780s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:09 devstack sudo[104440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae
Aug 26 03:13:09 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:09 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae" returned: 0 in 0.380s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5378e7d-f598-42bc-bce0-1ac87ae18d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98d1db0-0102-4d25-8a41-f40e3698d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Volume volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae (a44fc5d3-c21b-4ca8-9f57-356005b87dae): created successfully
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98d1db0-0102-4d25-8a41-f40e3698d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (2efae529-3962-459d-b8ef-632ab96c2dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6dc10a3d-1df5-4fa5-908c-0f0b4658fed2 tempest-GroupSnapshotsTest-1464659339 None] Created volume successfully.
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (7e5320d3-f52e-4f5e-908a-363474fc5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4d9dab-f78c-4fd6-906b-7a266d23a12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4d9dab-f78c-4fd6-906b-7a266d23a12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613167372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=576fe4d5-fcb1-4cd4-b5ea-e2cd5a610c65,host='devstack@QuobyteHD#QuobyteHD',id=6108f61c-6fdb-4a1d-9369-69615bf1aed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:12Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2af8fbd7-17de-4c75-8de9-da9661d22ab4),volume_type_id=2af8fbd7-17de-4c75-8de9-da9661d22ab4)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09342f5d-5491-4dc5-8811-d8897b1d0044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09342f5d-5491-4dc5-8811-d8897b1d0044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ca3a3c-c9bc-4a12-82ad-f9c58af76134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ca3a3c-c9bc-4a12-82ad-f9c58af76134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6108f61c-6fdb-4a1d-9369-69615bf1aed3', 'volume_name': 'volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cb24e6-a9df-46b7-8bab-c47cb35dc5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cb24e6-a9df-46b7-8bab-c47cb35dc5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492071dc-74cb-42fa-b21f-b3e9697767d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Volume 6108f61c-6fdb-4a1d-9369-69615bf1aed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3', 'volume_size': 1}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=576fe4d5-fcb1-4cd4-b5ea-e2cd5a610c65,created_at=2026-08-26T01:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1613167372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=576fe4d5-fcb1-4cd4-b5ea-e2cd5a610c65,host='devstack@QuobyteHD#QuobyteHD',id=6108f61c-6fdb-4a1d-9369-69615bf1aed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:12Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2af8fbd7-17de-4c75-8de9-da9661d22ab4),volume_type_id=2af8fbd7-17de-4c75-8de9-da9661d22ab4)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Creating volume 6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:11 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:11 devstack sudo[104444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 1073741824
Aug 26 03:13:11 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Flow 'volume_create_manager' (f697c653-58c0-4cac-8ea9-cdf61ce21df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919883bf-2428-477c-852c-29352d0c8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919883bf-2428-477c-852c-29352d0c8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-40836633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8237c016-d926-4d05-a90e-795a1560b7ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c793d593aa1477783a559bbba9231a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:12Z,use_quota=True,user_id='9695d4d868ec4e299c78c83a8c21d022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:12 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d305a66c-986d-44a1-9246-73122afb7ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d305a66c-986d-44a1-9246-73122afb7ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e10e6cc-f0c8-438d-8a27-eb543ef3194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e10e6cc-f0c8-438d-8a27-eb543ef3194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8237c016-d926-4d05-a90e-795a1560b7ab', 'volume_name': 'volume-8237c016-d926-4d05-a90e-795a1560b7ab', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abff8a1d-5d67-447d-997a-8f0bc8b431a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abff8a1d-5d67-447d-997a-8f0bc8b431a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb247c02-5c66-4728-95cf-26ef50ff7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:12 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Volume 8237c016-d926-4d05-a90e-795a1560b7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8237c016-d926-4d05-a90e-795a1560b7ab', 'volume_size': 1}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 1073741824" returned: 0 in 0.749s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:12 devstack sudo[104449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:12 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:12 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3
Aug 26 03:13:12 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:12 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:13:12 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3" returned: 0 in 0.317s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-40836633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8237c016-d926-4d05-a90e-795a1560b7ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c793d593aa1477783a559bbba9231a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:12Z,use_quota=True,user_id='9695d4d868ec4e299c78c83a8c21d022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Creating volume 8237c016-d926-4d05-a90e-795a1560b7ab {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:12 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492071dc-74cb-42fa-b21f-b3e9697767d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:13 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab 1073741824
Aug 26 03:13:13 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab887bd-255b-4df0-9840-4c1264bc87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Volume volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 (6108f61c-6fdb-4a1d-9369-69615bf1aed3): created successfully
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab887bd-255b-4df0-9840-4c1264bc87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (7e5320d3-f52e-4f5e-908a-363474fc5204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0a5bd859-2108-45af-aa82-5a5096455bf7 tempest-GroupSnapshotsTest-1464659339 None] Created volume successfully.
Aug 26 03:13:13 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab 1073741824" returned: 0 in 0.645s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:13 devstack sudo[104464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab
Aug 26 03:13:13 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:13 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab" returned: 0 in 0.304s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb247c02-5c66-4728-95cf-26ef50ff7322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8237c016-d926-4d05-a90e-795a1560b7ab', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7c39ea-0a8c-4efb-b050-54c6d0dd7523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Volume volume-8237c016-d926-4d05-a90e-795a1560b7ab (8237c016-d926-4d05-a90e-795a1560b7ab): created successfully
Aug 26 03:13:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7c39ea-0a8c-4efb-b050-54c6d0dd7523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Flow 'volume_create_manager' (f697c653-58c0-4cac-8ea9-cdf61ce21df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-9366b856-a10f-44fe-8c3f-c8c6aa2b5036 req-a41b4b5e-010d-4475-b4fa-9a0406b072e5 tempest-VolumesGetTestJSON-1598310164 None] Created volume successfully.
Aug 26 03:13:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a1de4fbe-132c-44ca-878f-9bf91a3a56c9 tempest-GroupSnapshotsTest-1464659339 None] Update group completed successfully.
Aug 26 03:13:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Acquiring lock "cinder-8237c016-d926-4d05-a90e-795a1560b7ab-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Lock "cinder-8237c016-d926-4d05-a90e-795a1560b7ab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Acquiring lock "cinder-quobyte-8237c016-d926-4d05-a90e-795a1560b7ab" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Lock "cinder-quobyte-8237c016-d926-4d05-a90e-795a1560b7ab" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:15 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae992ac9-615e-41ed-97e6-8fba0080d0b6]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:15 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab
Aug 26 03:13:15 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:15 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab" returned: 0 in 0.502s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:15 devstack sudo[104483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab
Aug 26 03:13:15 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-40eef3f8-f839-4622-873b-fb4c0bc10a8a tempest-GroupSnapshotsTest-1464659339 None] Update group completed successfully.
Aug 26 03:13:16 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8237c016-d926-4d05-a90e-795a1560b7ab" returned: 0 in 0.500s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Lock "cinder-quobyte-8237c016-d926-4d05-a90e-795a1560b7ab" released by "delete_volume" :: held 1.104s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG cinder.quota [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Created reservations ['7d6f0e80-b26a-4a60-aceb-6f6d0374949a', 'f8d84a0b-59f3-4e2f-852b-7be32087fb1b', 'b8e6ea68-c317-4412-bce3-b5bf36e765b1', '11d58608-0aa1-480e-90b9-d04a1beb171b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:16 devstack sudo[104494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:16 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:16 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.289s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG cinder.manager [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Deleted volume successfully.
Aug 26 03:13:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-cf462253-5040-4487-8a97-f6137c15909b req-88bed5be-38e6-48ed-a945-46c391fb556c tempest-VolumesGetTestJSON-1598310164 None] Lock "cinder-8237c016-d926-4d05-a90e-795a1560b7ab-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-705bb3e1-42b3-4baa-88a1-3f349f510cc1 tempest-GroupSnapshotsTest-1464659339 None] Update group completed successfully.
Aug 26 03:13:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-61b60486-e0d9-443e-8026-5bbb990df649 tempest-GroupSnapshotsTest-1464659339 None] Update group completed successfully.
Aug 26 03:13:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] GroupSnapshot cc5e82cb-3bdf-421a-96c4-b6d62270c11c: creating.
Aug 26 03:13:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Group snapshot cc5e82cb-3bdf-421a-96c4-b6d62270c11c: creating. {{(pid=94326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 03:13:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Creating offline snapshot b1c8757f-579d-4132-a756-0822292cc5c9 of volume a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:13:20 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f2601-2aec-4060-8ccd-653ad3ee3234]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:20 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae
Aug 26 03:13:20 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:21 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae" returned: 0 in 0.655s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:21 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 1G
Aug 26 03:13:21 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:21 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 1G" returned: 0 in 0.701s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:21 devstack sudo[104565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9
Aug 26 03:13:21 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:22 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9" returned: 0 in 0.521s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:22 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:13:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:22 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9
Aug 26 03:13:22 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:22 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9" returned: 0 in 0.593s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:23 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info
Aug 26 03:13:23 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:23 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:23 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:23 devstack sudo[104579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info
Aug 26 03:13:23 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:23 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.info" returned: 0 in 0.336s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.288s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5858c43b-0f19-4a3a-bbab-91cd5e2dd57d tempest-GroupsTest-831122115 None] Group tempest-Group1-995952255: creating
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Creating offline snapshot e88ed400-4eae-459a-ab43-0fe69a132ac7 of volume 6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4936e6-c648-4fbb-b757-43870c71b4b7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5858c43b-0f19-4a3a-bbab-91cd5e2dd57d tempest-GroupsTest-831122115 None] Group tempest-Group1-995952255: created successfully
Aug 26 03:13:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5858c43b-0f19-4a3a-bbab-91cd5e2dd57d tempest-GroupsTest-831122115 None] Create group completed successfully.
Aug 26 03:13:23 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3
Aug 26 03:13:23 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:24 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:24 devstack sudo[104587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 1G
Aug 26 03:13:24 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:24 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 1G" returned: 0 in 0.732s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:24 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7
Aug 26 03:13:24 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e77d7cd2-3b4e-4129-9ab4-82c06de672db tempest-GroupsTest-831122115 None] Group tempest-Group2-901617713: creating
Aug 26 03:13:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e77d7cd2-3b4e-4129-9ab4-82c06de672db tempest-GroupsTest-831122115 None] Group tempest-Group2-901617713: created successfully
Aug 26 03:13:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e77d7cd2-3b4e-4129-9ab4-82c06de672db tempest-GroupsTest-831122115 None] Create group completed successfully.
Aug 26 03:13:25 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7" returned: 0 in 0.461s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:25 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:13:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:25 devstack sudo[104598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7
Aug 26 03:13:25 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:25 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7" returned: 0 in 0.469s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:25 devstack sudo[104602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info
Aug 26 03:13:25 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:26 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info" returned: 0 in 0.507s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:26 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:13:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:26 devstack sudo[104606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info
Aug 26 03:13:26 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:26 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.info" returned: 0 in 0.513s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Flow 'volume_create_manager' (d26432f6-9480-4596-ae80-94d82d5be2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90954135-4f13-48bc-b35a-15345271463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90954135-4f13-48bc-b35a-15345271463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-554212931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff4ad4da-e715-49d4-bb07-1c6bcbf8e4ae,host='devstack@QuobyteHD#QuobyteHD',id=7fb1f32c-ed49-402c-b0f0-6986ba9fac23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e774c243e294420096c7ea05a7a71115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:27Z,use_quota=True,user_id='c755a15559504cbcb682f450834ed6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c73b4328-f502-4bf5-9ecf-543781c8c2c5),volume_type_id=c73b4328-f502-4bf5-9ecf-543781c8c2c5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd1dc06-c2d8-4408-bc54-74425855a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd1dc06-c2d8-4408-bc54-74425855a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd86eae-bbd3-4b4a-be52-6ab3af43211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd86eae-bbd3-4b4a-be52-6ab3af43211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb1f32c-ed49-402c-b0f0-6986ba9fac23', 'volume_name': 'volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d9ecc9-275b-4b78-9af0-3c9002e1dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d9ecc9-275b-4b78-9af0-3c9002e1dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dce6892-994a-46c3-91a5-806647314ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:27 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Volume 7fb1f32c-ed49-402c-b0f0-6986ba9fac23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23', 'volume_size': 1}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ff4ad4da-e715-49d4-bb07-1c6bcbf8e4ae,created_at=2026-08-26T01:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-554212931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff4ad4da-e715-49d4-bb07-1c6bcbf8e4ae,host='devstack@QuobyteHD#QuobyteHD',id=7fb1f32c-ed49-402c-b0f0-6986ba9fac23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e774c243e294420096c7ea05a7a71115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:27Z,use_quota=True,user_id='c755a15559504cbcb682f450834ed6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c73b4328-f502-4bf5-9ecf-543781c8c2c5),volume_type_id=c73b4328-f502-4bf5-9ecf-543781c8c2c5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Creating volume 7fb1f32c-ed49-402c-b0f0-6986ba9fac23 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:27 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-03017ea8-513a-4242-83b1-f8b79ee8a506 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot cc5e82cb-3bdf-421a-96c4-b6d62270c11c: created successfully
Aug 26 03:13:27 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 1073741824
Aug 26 03:13:27 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:28 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 1073741824" returned: 0 in 0.583s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:28 devstack sudo[104639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23
Aug 26 03:13:28 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot cc5e82cb-3bdf-421a-96c4-b6d62270c11c: deleting
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot cc5e82cb-3bdf-421a-96c4-b6d62270c11c: deleting {{(pid=94326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-a44fc5d3-c21b-4ca8-9f57-356005b87dae" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-a44fc5d3-c21b-4ca8-9f57-356005b87dae" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-b1c8757f-579d-4132-a756-0822292cc5c9" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-b1c8757f-579d-4132-a756-0822292cc5c9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Deleting offline snapshot b1c8757f-579d-4132-a756-0822292cc5c9 of volume a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] snapshot_file for this snap is: volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[911b57b5-a561-4804-9032-5d2c4c238341]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:28 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23" returned: 0 in 0.465s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:28 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9
Aug 26 03:13:28 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dce6892-994a-46c3-91a5-806647314ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccf8c61-fdc3-41de-8259-a50193db883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Volume volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 (7fb1f32c-ed49-402c-b0f0-6986ba9fac23): created successfully
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccf8c61-fdc3-41de-8259-a50193db883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Flow 'volume_create_manager' (d26432f6-9480-4596-ae80-94d82d5be2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-47f838e2-094a-455c-85de-19b058da1107 tempest-GroupsTest-831122115 None] Created volume successfully.
Aug 26 03:13:28 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9" returned: 0 in 0.535s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aa8358-d248-4064-8fb6-d7c3d41f2f2b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:29 devstack sudo[104648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae
Aug 26 03:13:29 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:29 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae" returned: 0 in 0.391s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:29 devstack sudo[104654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9
Aug 26 03:13:29 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:29 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9" returned: 0 in 0.454s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:29 devstack sudo[104660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9
Aug 26 03:13:29 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:30 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae.b1c8757f-579d-4132-a756-0822292cc5c9" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-b1c8757f-579d-4132-a756-0822292cc5c9" released by "_delete_snapshot" :: held 1.897s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-a44fc5d3-c21b-4ca8-9f57-356005b87dae" released by "delete_snapshot" :: held 1.931s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-6108f61c-6fdb-4a1d-9369-69615bf1aed3" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-6108f61c-6fdb-4a1d-9369-69615bf1aed3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-e88ed400-4eae-459a-ab43-0fe69a132ac7" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-e88ed400-4eae-459a-ab43-0fe69a132ac7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Deleting offline snapshot e88ed400-4eae-459a-ab43-0fe69a132ac7 of volume 6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] snapshot_file for this snap is: volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4f9f8a-e68c-46fb-a0d8-13e4ac6008a7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:30 devstack sudo[104663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7
Aug 26 03:13:30 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Acquiring lock "cinder-quobyte-7fb1f32c-ed49-402c-b0f0-6986ba9fac23" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Lock "cinder-quobyte-7fb1f32c-ed49-402c-b0f0-6986ba9fac23" acquired by "delete_volume" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c73885-6a04-4a11-8d61-2e1e3275677c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:30 devstack sudo[104665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23
Aug 26 03:13:30 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:31 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7" returned: 0 in 0.617s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707a7b7-d49c-4a72-b822-06c2a7c1ef9a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:31 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:31 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3
Aug 26 03:13:31 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23" returned: 0 in 0.525s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:31 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23
Aug 26 03:13:31 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:31 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3" returned: 0 in 0.457s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:31 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7fb1f32c-ed49-402c-b0f0-6986ba9fac23" returned: 0 in 0.335s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Lock "cinder-quobyte-7fb1f32c-ed49-402c-b0f0-6986ba9fac23" released by "delete_volume" :: held 0.928s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:31 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7
Aug 26 03:13:31 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Created reservations ['41f7eec8-7cdc-4fa0-abb6-290103b41053'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:31 devstack cinder-volume[94326]: WARNING cinder.quota [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1015031428 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1015031428, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:31 devstack cinder-volume[94326]: WARNING cinder.quota [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1015031428 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1015031428, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Created reservations ['1579c86e-4272-4932-afb5-7e4897739083', 'eb43bc2c-97c0-45f8-b4cd-307cc891e80d', '91ea8e69-3bb1-4643-9596-dc6d38a1f7c4', 'cdb2a556-3689-45ec-ae73-34cdfb46ba77'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:31 devstack sudo[104687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:31 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:32 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7" returned: 0 in 0.593s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:32 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7
Aug 26 03:13:32 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Created reservations ['b3352c57-66b7-4c46-bbd5-39f1a343bc57'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:32 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.396s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-80528742-7f99-4f4d-9c53-4df171fc02f8 tempest-GroupsTest-831122115 None] Delete group completed successfully.
Aug 26 03:13:32 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:32 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:32 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3.e88ed400-4eae-459a-ab43-0fe69a132ac7" returned: 0 in 0.434s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-e88ed400-4eae-459a-ab43-0fe69a132ac7" released by "_delete_snapshot" :: held 2.234s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-6108f61c-6fdb-4a1d-9369-69615bf1aed3" released by "delete_snapshot" :: held 2.274s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:32 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.353s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-11d18a98-214e-4216-b246-bc2ae74d20ac tempest-GroupsTest-831122115 None] Delete group completed successfully.
Aug 26 03:13:32 devstack cinder-volume[94326]: WARNING cinder.quota [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1718054359 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1718054359, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:32 devstack cinder-volume[94326]: WARNING cinder.quota [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1718054359 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1718054359, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['e0907f4e-1141-41d5-9a48-e3bc13735a63', 'cd4051b7-9a12-4af1-87fd-22a4372c0ff5', '2f09a924-2f8d-4c34-9875-f3dddb54ff63', '5b3da5a2-9d77-46ad-afc1-cf721ca6cb27'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:32 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['b1fa18ab-caef-4a5b-acc0-bcffde58c964', '0d130357-93f3-4202-89e8-7e0d4384b354', '92e386db-2b69-4389-9f0e-e91c243d7a84', '346c02a5-17d3-411d-9002-2f88f0be1e20'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ba02747e-6dfe-4620-8540-6f014a007e15 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot cc5e82cb-3bdf-421a-96c4-b6d62270c11c: deleted successfully
Aug 26 03:13:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-6108f61c-6fdb-4a1d-9369-69615bf1aed3" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-6108f61c-6fdb-4a1d-9369-69615bf1aed3" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:33 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c47506-aca2-4e44-8e8b-72e6aef88518]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6d0b95d4-8803-4787-b1bd-5a02f171221d tempest-GroupsTest-831122115 None] Group tempest-GroupsTest-Group-1378147170: creating
Aug 26 03:13:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6d0b95d4-8803-4787-b1bd-5a02f171221d tempest-GroupsTest-831122115 None] Group tempest-GroupsTest-Group-1378147170: created successfully
Aug 26 03:13:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6d0b95d4-8803-4787-b1bd-5a02f171221d tempest-GroupsTest-831122115 None] Create group completed successfully.
Aug 26 03:13:34 devstack sudo[104696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3
Aug 26 03:13:34 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:34 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3" returned: 0 in 0.642s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:34 devstack sudo[104701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3
Aug 26 03:13:34 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:35 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6108f61c-6fdb-4a1d-9369-69615bf1aed3" returned: 0 in 0.527s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-6108f61c-6fdb-4a1d-9369-69615bf1aed3" released by "delete_volume" :: held 1.343s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-a44fc5d3-c21b-4ca8-9f57-356005b87dae" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-a44fc5d3-c21b-4ca8-9f57-356005b87dae" acquired by "delete_volume" :: waited 0.059s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[113cdb56-dbfb-4956-ba1c-a14797e572e9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:35 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae
Aug 26 03:13:35 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:35 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae" returned: 0 in 0.573s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:35 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae
Aug 26 03:13:35 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:35 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Flow 'volume_create_manager' (115607d5-7345-4aaa-a96e-9b07c9d9f7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc04204-3fd0-4150-80cf-d7607651d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc04204-3fd0-4150-80cf-d7607651d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658672018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=54c7f4da-a1d5-4f68-bbf9-dcf0372164a5,host='devstack@QuobyteHD#QuobyteHD',id=e733154a-17d1-44d7-9c17-3016e79cba1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e774c243e294420096c7ea05a7a71115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:36Z,use_quota=True,user_id='c755a15559504cbcb682f450834ed6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad8aede-93b7-420c-927b-ae9bfe652712),volume_type_id=7ad8aede-93b7-420c-927b-ae9bfe652712)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f6500a-3ca3-4454-9be4-39f208fb9d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f6500a-3ca3-4454-9be4-39f208fb9d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c85feca-d397-407c-bbcd-4ce406323733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c85feca-d397-407c-bbcd-4ce406323733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e733154a-17d1-44d7-9c17-3016e79cba1b', 'volume_name': 'volume-e733154a-17d1-44d7-9c17-3016e79cba1b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ec12a2-77da-4568-98dc-3ff40a857c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ec12a2-77da-4568-98dc-3ff40a857c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec4099e-4a7d-4bae-8627-9cab5a1cc8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:36 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Volume e733154a-17d1-44d7-9c17-3016e79cba1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e733154a-17d1-44d7-9c17-3016e79cba1b', 'volume_size': 1}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=54c7f4da-a1d5-4f68-bbf9-dcf0372164a5,created_at=2026-08-26T01:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1658672018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=54c7f4da-a1d5-4f68-bbf9-dcf0372164a5,host='devstack@QuobyteHD#QuobyteHD',id=e733154a-17d1-44d7-9c17-3016e79cba1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e774c243e294420096c7ea05a7a71115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:36Z,use_quota=True,user_id='c755a15559504cbcb682f450834ed6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad8aede-93b7-420c-927b-ae9bfe652712),volume_type_id=7ad8aede-93b7-420c-927b-ae9bfe652712)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Creating volume e733154a-17d1-44d7-9c17-3016e79cba1b {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:36 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:36 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b 1073741824
Aug 26 03:13:36 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:36 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a44fc5d3-c21b-4ca8-9f57-356005b87dae" returned: 0 in 0.320s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-a44fc5d3-c21b-4ca8-9f57-356005b87dae" released by "delete_volume" :: held 1.007s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['f4acbcc5-fdfe-4fa7-bfeb-0bb2ef5ce714'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:36 devstack cinder-volume[94326]: WARNING cinder.quota [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1718054359 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1718054359, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['5c9238d7-7cc4-412c-a170-04df5590342b', '5006d064-bff0-4561-9ba1-bbe2226ea030', '7a643d48-e87e-41b8-81e6-652871ef6588', '3fd41595-7cc2-4fa2-b80b-b1e76568248d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['d7b6910d-608e-43a1-a54a-52aa670d4e04', 'f1e1fcd1-d4a4-4bb9-8001-8d21fc068059', '602d9abd-307c-4f38-9f6c-dcfbba12eeda', '69168575-de03-4404-9a87-ac0cfcb0d15a'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:36 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b 1073741824" returned: 0 in 0.661s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:36 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:36 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:36 devstack sudo[104746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b
Aug 26 03:13:36 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:37 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.284s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-41005d28-9909-432d-9116-c6b761ae1357 tempest-GroupSnapshotsTest-1464659339 None] Delete group completed successfully.
Aug 26 03:13:37 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b" returned: 0 in 0.296s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec4099e-4a7d-4bae-8627-9cab5a1cc8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e733154a-17d1-44d7-9c17-3016e79cba1b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516ade5f-a6c1-4208-b939-c91917771cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Volume volume-e733154a-17d1-44d7-9c17-3016e79cba1b (e733154a-17d1-44d7-9c17-3016e79cba1b): created successfully
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516ade5f-a6c1-4208-b939-c91917771cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Flow 'volume_create_manager' (115607d5-7345-4aaa-a96e-9b07c9d9f7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c108c44c-9b8d-4e8f-9ff0-0b3c75ebfaa0 tempest-GroupsTest-831122115 None] Created volume successfully.
Aug 26 03:13:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1050979e-9a53-407d-98b0-786c36a3228f tempest-GroupSnapshotsTest-1464659339 None] Group tempest-GroupSnapshotsTest-Group-1106485728: creating
Aug 26 03:13:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1050979e-9a53-407d-98b0-786c36a3228f tempest-GroupSnapshotsTest-1464659339 None] Group tempest-GroupSnapshotsTest-Group-1106485728: created successfully
Aug 26 03:13:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1050979e-9a53-407d-98b0-786c36a3228f tempest-GroupSnapshotsTest-1464659339 None] Create group completed successfully.
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Flow 'volume_create_manager' (1ca348a6-348b-46eb-a5d9-7b2e15e7d436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520e68aa-13f5-4ecd-ac50-b8555b874761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520e68aa-13f5-4ecd-ac50-b8555b874761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2049993615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=54c7f4da-a1d5-4f68-bbf9-dcf0372164a5,host='devstack@QuobyteHD#QuobyteHD',id=822467d9-517c-4fc3-8526-0d8a2be731bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e774c243e294420096c7ea05a7a71115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:39Z,use_quota=True,user_id='c755a15559504cbcb682f450834ed6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad8aede-93b7-420c-927b-ae9bfe652712),volume_type_id=7ad8aede-93b7-420c-927b-ae9bfe652712)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cd10f0-ca8b-4f2b-b432-40bf7a39f8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cd10f0-ca8b-4f2b-b432-40bf7a39f8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2486ebb9-386e-433c-8dd7-62e294f6a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2486ebb9-386e-433c-8dd7-62e294f6a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822467d9-517c-4fc3-8526-0d8a2be731bb', 'volume_name': 'volume-822467d9-517c-4fc3-8526-0d8a2be731bb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23629fd-c278-4bb7-b15d-00ab7d7a2243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23629fd-c278-4bb7-b15d-00ab7d7a2243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4a06e0-f619-4cb0-ae0f-279e12a5246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:39 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Volume 822467d9-517c-4fc3-8526-0d8a2be731bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822467d9-517c-4fc3-8526-0d8a2be731bb', 'volume_size': 1}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=54c7f4da-a1d5-4f68-bbf9-dcf0372164a5,created_at=2026-08-26T01:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2049993615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=54c7f4da-a1d5-4f68-bbf9-dcf0372164a5,host='devstack@QuobyteHD#QuobyteHD',id=822467d9-517c-4fc3-8526-0d8a2be731bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e774c243e294420096c7ea05a7a71115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:39Z,use_quota=True,user_id='c755a15559504cbcb682f450834ed6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad8aede-93b7-420c-927b-ae9bfe652712),volume_type_id=7ad8aede-93b7-420c-927b-ae9bfe652712)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Creating volume 822467d9-517c-4fc3-8526-0d8a2be731bb {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:39 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:39 devstack sudo[104751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb 1073741824
Aug 26 03:13:39 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:39 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb 1073741824" returned: 0 in 0.505s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=165,cinder:UPDATE=172,cinder:INSERT=37,cinder:DELETE=6 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=157,cinder:UPDATE=174,cinder:INSERT=43,cinder:DELETE=8 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:39 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb
Aug 26 03:13:39 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:39 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (adf5a1a5-db32-4e77-8a63-ec1264f5e4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677b2547-f7b6-40e5-a8cd-026b800aa4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677b2547-f7b6-40e5-a8cd-026b800aa4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-798710647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7e7cc3c7-3ffb-4546-a278-2c5ede0854a3,host='devstack@QuobyteHD#QuobyteHD',id=ccfd6e8f-e926-4634-9a27-a7c02ca98b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:40Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78516ebe-344d-475b-91e5-18e01e93a163),volume_type_id=78516ebe-344d-475b-91e5-18e01e93a163)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd8d0da-e9c2-4d23-a3bc-b7762d006d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd8d0da-e9c2-4d23-a3bc-b7762d006d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c4b7b0-c2fb-4a8d-af1a-a59869e1c4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c4b7b0-c2fb-4a8d-af1a-a59869e1c4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfd6e8f-e926-4634-9a27-a7c02ca98b7e', 'volume_name': 'volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d118bdef-0a48-4b7a-985a-2797e210cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d118bdef-0a48-4b7a-985a-2797e210cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b05032-b2dc-4c26-b683-54600703092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:40 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Volume ccfd6e8f-e926-4634-9a27-a7c02ca98b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e', 'volume_size': 1}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:40 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb" returned: 0 in 0.626s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7e7cc3c7-3ffb-4546-a278-2c5ede0854a3,created_at=2026-08-26T01:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-798710647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7e7cc3c7-3ffb-4546-a278-2c5ede0854a3,host='devstack@QuobyteHD#QuobyteHD',id=ccfd6e8f-e926-4634-9a27-a7c02ca98b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e76f9adabb4e32bcf270b99b2376e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:40Z,use_quota=True,user_id='adbb60d5ade24a7b872a504c33a0dd34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78516ebe-344d-475b-91e5-18e01e93a163),volume_type_id=78516ebe-344d-475b-91e5-18e01e93a163)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Creating volume ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:40 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4a06e0-f619-4cb0-ae0f-279e12a5246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822467d9-517c-4fc3-8526-0d8a2be731bb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:40 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e 1073741824
Aug 26 03:13:40 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58044ae0-7324-4472-a9a3-ee61053bb70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:40 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Volume volume-822467d9-517c-4fc3-8526-0d8a2be731bb (822467d9-517c-4fc3-8526-0d8a2be731bb): created successfully
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58044ae0-7324-4472-a9a3-ee61053bb70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Flow 'volume_create_manager' (1ca348a6-348b-46eb-a5d9-7b2e15e7d436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0cfc3427-7236-4a0a-83d0-a44b72aac922 tempest-GroupsTest-831122115 None] Created volume successfully.
Aug 26 03:13:40 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e 1073741824" returned: 0 in 0.519s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:40 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e
Aug 26 03:13:40 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:41 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b05032-b2dc-4c26-b683-54600703092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9b3bfb-d987-4796-9f46-eb5008ff314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Volume volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e (ccfd6e8f-e926-4634-9a27-a7c02ca98b7e): created successfully
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9b3bfb-d987-4796-9f46-eb5008ff314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Flow 'volume_create_manager' (adf5a1a5-db32-4e77-8a63-ec1264f5e4e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f7ee19bf-40be-4ef1-93ca-074374838997 tempest-GroupSnapshotsTest-1464659339 None] Created volume successfully.
Aug 26 03:13:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d27fbde-e1e9-43db-a3c0-ccac6db92767 tempest-GroupsTest-831122115 None] Update group completed successfully.
Aug 26 03:13:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] GroupSnapshot 7d3bd4c7-2d94-416e-8655-6ba6b02082f4: creating.
Aug 26 03:13:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Group snapshot 7d3bd4c7-2d94-416e-8655-6ba6b02082f4: creating. {{(pid=94326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 03:13:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Creating offline snapshot 801dec4d-957d-4cce-a631-e25a09e3e8f6 of volume ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:13:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67626618-6a53-434e-a149-decf9ed9999e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:42 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e
Aug 26 03:13:42 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0d280a75-72d4-4965-8527-76105997bceb tempest-GroupsTest-831122115 None] Update group completed successfully.
Aug 26 03:13:43 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" returned: 0 in 0.467s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:43 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 1G
Aug 26 03:13:43 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:43 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 1G" returned: 0 in 0.467s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:43 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6
Aug 26 03:13:43 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:43 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6" returned: 0 in 0.280s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:43 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:13:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:43 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6
Aug 26 03:13:43 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:44 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6" returned: 0 in 0.253s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:44 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info
Aug 26 03:13:44 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:44 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info" returned: 0 in 0.262s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:44 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:44 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info
Aug 26 03:13:44 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:44 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.info" returned: 0 in 0.267s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Acquiring lock "cinder-quobyte-822467d9-517c-4fc3-8526-0d8a2be731bb" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Lock "cinder-quobyte-822467d9-517c-4fc3-8526-0d8a2be731bb" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc56ef13-9fd5-426b-a92c-457754ef31f2]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-798e5971-2e6c-44e4-b322-e9ecf539ed89 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 7d3bd4c7-2d94-416e-8655-6ba6b02082f4: created successfully
Aug 26 03:13:44 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb
Aug 26 03:13:44 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 7d3bd4c7-2d94-416e-8655-6ba6b02082f4: deleting
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 7d3bd4c7-2d94-416e-8655-6ba6b02082f4: deleting {{(pid=94326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-801dec4d-957d-4cce-a631-e25a09e3e8f6" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-801dec4d-957d-4cce-a631-e25a09e3e8f6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Deleting offline snapshot 801dec4d-957d-4cce-a631-e25a09e3e8f6 of volume ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:13:45 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] snapshot_file for this snap is: volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb" returned: 0 in 0.497s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509f3e4-ed53-48f2-8942-9a179e177fe8]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:45 devstack sudo[104845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb
Aug 26 03:13:45 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Flow 'volume_create_manager' (e12a110b-83f0-4fd0-99ef-64d9ab694920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af8751-4ff3-470b-a5e2-c5473011559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af8751-4ff3-470b-a5e2-c5473011559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-436900642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d22d4e-722e-4dcd-b9e3-81e7292830b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac8fe61d314c7e889987c69ab6cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:45Z,use_quota=True,user_id='be34e4a8604440aeb000a7277f5163fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6f2313-6941-4aa4-9ce8-04428ce6243e),volume_type_id=0c6f2313-6941-4aa4-9ce8-04428ce6243e)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efabea71-4641-487f-9156-f823cbad2ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efabea71-4641-487f-9156-f823cbad2ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f56203b-f468-4889-9797-bc2dca25dd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f56203b-f468-4889-9797-bc2dca25dd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d22d4e-722e-4dcd-b9e3-81e7292830b5', 'volume_name': 'volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4efa6c-600e-47ba-8f24-bf4a992eb56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4efa6c-600e-47ba-8f24-bf4a992eb56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052239bb-ebe4-4b71-b485-85d06683ce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Volume b4d22d4e-722e-4dcd-b9e3-81e7292830b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5', 'volume_size': 1}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-436900642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d22d4e-722e-4dcd-b9e3-81e7292830b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac8fe61d314c7e889987c69ab6cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:45Z,use_quota=True,user_id='be34e4a8604440aeb000a7277f5163fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c6f2313-6941-4aa4-9ce8-04428ce6243e),volume_type_id=0c6f2313-6941-4aa4-9ce8-04428ce6243e)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Creating volume b4d22d4e-722e-4dcd-b9e3-81e7292830b5 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:45 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:45 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6
Aug 26 03:13:45 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:45 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 1073741824
Aug 26 03:13:45 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:45 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822467d9-517c-4fc3-8526-0d8a2be731bb" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Lock "cinder-quobyte-822467d9-517c-4fc3-8526-0d8a2be731bb" released by "delete_volume" :: held 0.892s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Acquiring lock "cinder-quobyte-e733154a-17d1-44d7-9c17-3016e79cba1b" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Lock "cinder-quobyte-e733154a-17d1-44d7-9c17-3016e79cba1b" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[074bcf07-6a78-4859-a2e6-69299f17dcb0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Flow 'volume_create_manager' (28f1fce1-fc19-4a15-bf96-bd14e21c4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3673035b-03f6-4a55-a427-85c3e503169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3673035b-03f6-4a55-a427-85c3e503169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1177293038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58445eea-584e-42dc-8d06-261ad5f9183c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac8fe61d314c7e889987c69ab6cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:46Z,use_quota=True,user_id='be34e4a8604440aeb000a7277f5163fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a358b52-cb91-409b-9813-554db44639e2),volume_type_id=5a358b52-cb91-409b-9813-554db44639e2)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb619987-458a-4346-ba41-3d4774dc6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb619987-458a-4346-ba41-3d4774dc6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec9f832-12d0-4e14-b957-bf8e4d086fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec9f832-12d0-4e14-b957-bf8e4d086fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58445eea-584e-42dc-8d06-261ad5f9183c', 'volume_name': 'volume-58445eea-584e-42dc-8d06-261ad5f9183c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cbd73c-b4df-4ba5-a4d4-36806a55a6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cbd73c-b4df-4ba5-a4d4-36806a55a6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42638d84-6291-43ac-b6d1-7a6e4bf7ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Volume 58445eea-584e-42dc-8d06-261ad5f9183c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58445eea-584e-42dc-8d06-261ad5f9183c', 'volume_size': 1}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6" returned: 0 in 0.594s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:13:45 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b
Aug 26 03:13:45 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f23dd-c2fb-46a5-8fa3-69aa51d93972]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:46 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 1073741824" returned: 0 in 0.603s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:46 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e
Aug 26 03:13:46 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:46 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5
Aug 26 03:13:46 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:46 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b" returned: 0 in 0.599s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:46 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b
Aug 26 03:13:46 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:46 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5" returned: 0 in 0.361s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:46 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1177293038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58445eea-584e-42dc-8d06-261ad5f9183c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac8fe61d314c7e889987c69ab6cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:46Z,use_quota=True,user_id='be34e4a8604440aeb000a7277f5163fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a358b52-cb91-409b-9813-554db44639e2),volume_type_id=5a358b52-cb91-409b-9813-554db44639e2)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Creating volume 58445eea-584e-42dc-8d06-261ad5f9183c {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:46 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" returned: 0 in 0.633s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:46 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c 1073741824
Aug 26 03:13:46 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:46 devstack sudo[104876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6
Aug 26 03:13:46 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052239bb-ebe4-4b71-b485-85d06683ce8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d217cd13-c086-49d1-93e2-49e13c8caa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Volume volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 (b4d22d4e-722e-4dcd-b9e3-81e7292830b5): created successfully
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d217cd13-c086-49d1-93e2-49e13c8caa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Flow 'volume_create_manager' (e12a110b-83f0-4fd0-99ef-64d9ab694920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:46 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-295edec7-95e5-4502-9c79-2182b21b2502 tempest-TestInstancesWithCinderVolumes-4022716 None] Created volume successfully.
Aug 26 03:13:46 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e733154a-17d1-44d7-9c17-3016e79cba1b" returned: 0 in 0.508s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Lock "cinder-quobyte-e733154a-17d1-44d7-9c17-3016e79cba1b" released by "delete_volume" :: held 1.184s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Flow 'volume_create_manager' (7cacf283-feda-4603-9463-37e74e2814b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84615fc5-657d-4eaf-bac8-b44442229b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84615fc5-657d-4eaf-bac8-b44442229b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1314432539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac8fe61d314c7e889987c69ab6cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:47Z,use_quota=True,user_id='be34e4a8604440aeb000a7277f5163fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d26a14a7-43a2-4ff2-99ad-8ba6ac962ecf),volume_type_id=d26a14a7-43a2-4ff2-99ad-8ba6ac962ecf)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be058b57-7c33-4867-8649-1d7b7592d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be058b57-7c33-4867-8649-1d7b7592d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7106ab48-84a2-4ac6-838a-3d2f07ce2ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Created reservations ['5650b730-d763-46ac-a7f8-063be752bd10'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:47 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6" returned: 0 in 0.660s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:47 devstack cinder-volume[94326]: WARNING cinder.quota [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1505069937 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1505069937, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:47 devstack cinder-volume[94326]: WARNING cinder.quota [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1505069937 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1505069937, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:47 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6
Aug 26 03:13:47 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Created reservations ['559f907b-bbbf-4642-adc0-c06edc35ba9b', 'f8aa2ebb-04bb-4732-8b18-72efda6cb00d', '82ab27e0-21b7-4547-9b8f-db2b2214ffeb', '1ff9af15-5bca-4df0-8017-d0566490afbd'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:47 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c 1073741824" returned: 0 in 0.818s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:47 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c
Aug 26 03:13:47 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Created reservations ['c8599167-2f16-4151-b306-d1b2826fd776', 'daa6fce0-949c-4273-b397-9e3aba382c52', 'c8291661-5056-443b-b86f-44d57b2b84f8', '94fade05-9275-4f79-b182-bde41dbba2cd'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7106ab48-84a2-4ac6-838a-3d2f07ce2ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82', 'volume_name': 'volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82', 'volume_size': 1, 'image_id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1138367487', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94ac8fe61d314c7e889987c69ab6cce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'created_at': datetime.datetime(2026, 8, 26, 1, 13, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 13, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0c0d250>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a25904-0f48-44f1-a87b-a8c56c5948f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a25904-0f48-44f1-a87b-a8c56c5948f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:47 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9022e150-9693-4a6b-9278-fb7be4334016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:47 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Volume 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82', 'volume_size': 1, 'image_id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1138367487', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94ac8fe61d314c7e889987c69ab6cce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'created_at': datetime.datetime(2026, 8, 26, 1, 13, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 13, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0c0d250>}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Trying to clone 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 from image 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e.801dec4d-957d-4cce-a631-e25a09e3e8f6" returned: 0 in 0.656s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:47 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c" returned: 0 in 0.512s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-801dec4d-957d-4cce-a631-e25a09e3e8f6" released by "_delete_snapshot" :: held 2.700s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" released by "delete_snapshot" :: held 2.744s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42638d84-6291-43ac-b6d1-7a6e4bf7ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58445eea-584e-42dc-8d06-261ad5f9183c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19545da6-9b3b-472d-8d54-21c91e614c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:48 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Volume volume-58445eea-584e-42dc-8d06-261ad5f9183c (58445eea-584e-42dc-8d06-261ad5f9183c): created successfully
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19545da6-9b3b-472d-8d54-21c91e614c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Flow 'volume_create_manager' (28f1fce1-fc19-4a15-bf96-bd14e21c4001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:13:48 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:48 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-17c1f3ae-201d-442b-91e5-f2dafffb565d tempest-TestInstancesWithCinderVolumes-4022716 None] Created volume successfully.
Aug 26 03:13:48 devstack cinder-volume[94326]: WARNING cinder.quota [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1171409942 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1171409942, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:48 devstack cinder-volume[94326]: WARNING cinder.quota [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1171409942 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1171409942, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['d603b0c4-e6ed-41d4-b99a-0c7b9cf7dcb3', 'eacd847a-7dfa-46f2-b26b-a8c3c0dfcb4d', '27df167e-9e73-46e6-a0c0-0d07400313c8', '32aa4c98-589b-493a-8071-12870a12715e'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4b60dfb9-a822-4325-b04b-96ee7492bff3 tempest-GroupSnapshotsTest-1464659339 None] group_snapshot 7d3bd4c7-2d94-416e-8655-6ba6b02082f4: deleted successfully
Aug 26 03:13:48 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:48 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-85e42467-c74b-424a-aacb-8135ef7d6efb tempest-GroupsTest-831122115 None] Delete group completed successfully.
Aug 26 03:13:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "cinder-quobyte-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:13:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:13:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec0bb4-98be-47ac-8e63-1e5583187061]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:49 devstack sudo[104934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e
Aug 26 03:13:49 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:49 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" returned: 0 in 0.538s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:49 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e
Aug 26 03:13:49 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:50 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" returned: 0 in 0.339s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Lock "cinder-quobyte-ccfd6e8f-e926-4634-9a27-a7c02ca98b7e" released by "delete_volume" :: held 0.995s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['74ca3df7-dc4d-4b5a-9fed-8b5360b05306'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:50 devstack cinder-volume[94326]: WARNING cinder.quota [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1171409942 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1171409942, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Created reservations ['2c4af96b-3910-42c2-94cf-3014c1812fd2', 'e3f70b0e-82e7-41fe-b8f5-065bf7a382ff', '240c9859-4a5c-4487-a142-7be202da6800', 'a08d25ef-1dfd-40e0-8202-e8e5ef041fe5'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:50 devstack sudo[104942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:13:50 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:50 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.353s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:50 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:13:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-18f03550-faeb-4889-aef8-5388dafa4351 tempest-GroupSnapshotsTest-1464659339 None] Delete group completed successfully.
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD, size 20.69 MB, duration 5.29 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:13:53 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Image download 20.69 MB at 3.91 MB/s
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069444d-45db-409b-93e6-dee6717a6963]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:53 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD
Aug 26 03:13:53 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:53 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Temporary image 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc is fetched for user be34e4a8604440aeb000a7277f5163fc. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb57fab-65b4-4524-90a3-a367cb25ed86]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:53 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD
Aug 26 03:13:53 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-35dfc4e7-a7c4-4b58-90b8-af47b852e8a8 req-6391b0f2-79f2-4d66-ae3a-c3b0f3a43f27 tempest-AttachVolumeNegativeTest-719800185 None] Terminate volume connection completed successfully.
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-35dfc4e7-a7c4-4b58-90b8-af47b852e8a8 req-6391b0f2-79f2-4d66-ae3a-c3b0f3a43f27 tempest-AttachVolumeNegativeTest-719800185 None] Deleting attachment ebaebc2e-0415-491b-bc7a-a294dbb0caed. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:13:54 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1314432539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ac8fe61d314c7e889987c69ab6cce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:47Z,use_quota=True,user_id='be34e4a8604440aeb000a7277f5163fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d26a14a7-43a2-4ff2-99ad-8ba6ac962ecf),volume_type_id=d26a14a7-43a2-4ff2-99ad-8ba6ac962ecf)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Creating volume 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:13:54 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:54 devstack sudo[104972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 1073741824
Aug 26 03:13:54 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:54 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 1073741824" returned: 0 in 0.721s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:55 devstack sudo[104978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82
Aug 26 03:13:55 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:55 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" returned: 0 in 0.408s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Attempting download of 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc ((None, [{'url': 'file:///opt/stack/data/glance/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'metadata': {}}])) to volume 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f0443-4b34-47e8-8931-8a6ed1b5d19f]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:55 devstack sudo[105003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv
Aug 26 03:13:55 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:55 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv" returned: 0 in 0.411s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:56 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv
Aug 26 03:13:56 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:56 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv" returned: 1 in 0.570s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_6_fptixv' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:13:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5945e4-2b27-4610-aa80-12734446dbbe]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:13:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:56 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD
Aug 26 03:13:56 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:57 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:57 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc was qcow2, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:13:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:57 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82
Aug 26 03:13:57 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-823f107a-9da3-4853-8792-2409f4aced2c tempest-GroupsV314Test-123158151 None] Group tempest-GroupsV314Test-Group-1898485802: creating
Aug 26 03:13:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-823f107a-9da3-4853-8792-2409f4aced2c tempest-GroupsV314Test-123158151 None] Group tempest-GroupsV314Test-Group-1898485802: created successfully
Aug 26 03:13:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-823f107a-9da3-4853-8792-2409f4aced2c tempest-GroupsV314Test-123158151 None] Create group completed successfully.
Aug 26 03:13:59 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" returned: 0 in 2.458s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc_53cs64zndevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:13:59 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Converted 112.00 MB image at 45.54 MB/s
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:13:59 devstack sudo[105030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 1G
Aug 26 03:13:59 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:13:59 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 1G" returned: 0 in 0.426s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Downloaded image 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc ((None, [{'url': 'file:///opt/stack/data/glance/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'metadata': {}}])) to volume 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Temporary image 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc for user be34e4a8604440aeb000a7277f5163fc is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Marking volume 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Copying metadata from image 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc to 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:13:59 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Creating volume glance metadata for volume 2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 backed by image 2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc with: {'image_id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'image_name': 'tempest-scenario-img--1138367487', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9022e150-9693-4a6b-9278-fb7be4334016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82', 'volume_size': 1, 'image_id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1138367487', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94ac8fe61d314c7e889987c69ab6cce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc', 'created_at': datetime.datetime(2026, 8, 26, 1, 13, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 13, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fa98ade-eafa-4ffc-9140-cd0bf4cad7cc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0c0d250>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107a9047-aba8-423b-9841-b19cf47a1c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Volume volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 (2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82): created successfully
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107a9047-aba8-423b-9841-b19cf47a1c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Flow 'volume_create_manager' (7cacf283-feda-4603-9463-37e74e2814b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4654a930-3244-48d4-b2ae-310ff71f805c tempest-TestInstancesWithCinderVolumes-4022716 None] Created volume successfully.
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Flow 'volume_create_manager' (492ec422-1248-4b79-bc78-34380b499e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b945277-a4aa-4e3b-a6d4-04c0a33b3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b945277-a4aa-4e3b-a6d4-04c0a33b3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818235059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1ab0df-e09a-4302-b928-63b9dd2aa811,host='devstack@QuobyteHD#QuobyteHD',id=4b39852d-f296-4ea3-9dee-35041c13cd05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec66ed2e182b42a0996bf0fd812d9f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:01Z,use_quota=True,user_id='4d7a91afd1dd472f8f5e195e1881316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6a721c8-4ecc-441e-8759-97cf30cbbca3),volume_type_id=b6a721c8-4ecc-441e-8759-97cf30cbbca3)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc2232e-1409-4a0c-b0f2-adcbd247c1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc2232e-1409-4a0c-b0f2-adcbd247c1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11405c7b-8dc7-4f38-a6fd-d5dfac46ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11405c7b-8dc7-4f38-a6fd-d5dfac46ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b39852d-f296-4ea3-9dee-35041c13cd05', 'volume_name': 'volume-4b39852d-f296-4ea3-9dee-35041c13cd05', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad71897-9e67-4276-af77-b4a85b6db6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad71897-9e67-4276-af77-b4a85b6db6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401c2e79-afe1-4ccf-af3c-0407c7731b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Volume 4b39852d-f296-4ea3-9dee-35041c13cd05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b39852d-f296-4ea3-9dee-35041c13cd05', 'volume_size': 1}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f1ab0df-e09a-4302-b928-63b9dd2aa811,created_at=2026-08-26T01:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818235059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f1ab0df-e09a-4302-b928-63b9dd2aa811,host='devstack@QuobyteHD#QuobyteHD',id=4b39852d-f296-4ea3-9dee-35041c13cd05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec66ed2e182b42a0996bf0fd812d9f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:01Z,use_quota=True,user_id='4d7a91afd1dd472f8f5e195e1881316f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6a721c8-4ecc-441e-8759-97cf30cbbca3),volume_type_id=b6a721c8-4ecc-441e-8759-97cf30cbbca3)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Creating volume 4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:14:00 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:14:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:00 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 1073741824
Aug 26 03:14:00 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:01 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 1073741824" returned: 0 in 0.626s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:01 devstack sudo[105043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05
Aug 26 03:14:01 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:01 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05" returned: 0 in 0.288s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401c2e79-afe1-4ccf-af3c-0407c7731b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b39852d-f296-4ea3-9dee-35041c13cd05', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f322431d-0d66-45fb-b4ab-00d41a674de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:01 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Volume volume-4b39852d-f296-4ea3-9dee-35041c13cd05 (4b39852d-f296-4ea3-9dee-35041c13cd05): created successfully
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f322431d-0d66-45fb-b4ab-00d41a674de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Flow 'volume_create_manager' (492ec422-1248-4b79-bc78-34380b499e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-469e0982-898a-4679-bf57-1f2bb7171e08 tempest-GroupsV314Test-123158151 None] Created volume successfully.
Aug 26 03:14:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:03 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Cloning volume 4b39852d-f296-4ea3-9dee-35041c13cd05 to volume a3f74944-94de-4950-95ac-cef0f7679551
Aug 26 03:14:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Creating offline snapshot 26ecc1b4-c2f3-442b-805b-996a6b6e4663 of volume 4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:14:04 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[07459a0b-d16e-483e-9b9f-1068352a9921]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:04 devstack sudo[105052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05
Aug 26 03:14:04 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:04 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05" returned: 0 in 0.460s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:04 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 1G
Aug 26 03:14:04 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-70448d25-c440-492e-a539-6e9270435615 req-0b40c5a0-5e5f-409e-84f7-eeab3caee75d tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:05 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 1G" returned: 0 in 0.669s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b39852d-f296-4ea3-9dee-35041c13cd05 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:05 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b39852d-f296-4ea3-9dee-35041c13cd05 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663
Aug 26 03:14:05 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Flow 'volume_create_manager' (53f4ce39-b48b-44d0-9830-a8171fc0e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb79e9f-bd30-4513-bc83-f49b93c5fba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb79e9f-bd30-4513-bc83-f49b93c5fba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-454408721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe5040b-85f7-4d45-b720-69a054c2aebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad62a33f023462a86edd564302cd8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:05Z,use_quota=True,user_id='9d3f0dea130c48939ecb455da64730e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d024ce-0787-4dc4-a4f8-942f3961786c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d024ce-0787-4dc4-a4f8-942f3961786c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a67450-3d7a-433b-85fb-af9674eb8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a67450-3d7a-433b-85fb-af9674eb8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe5040b-85f7-4d45-b720-69a054c2aebe', 'volume_name': 'volume-efe5040b-85f7-4d45-b720-69a054c2aebe', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883436da-a5a3-44fd-9e1b-64f282ef06d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883436da-a5a3-44fd-9e1b-64f282ef06d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba83d4b-da0a-4286-935e-f7a8860e4d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Volume efe5040b-85f7-4d45-b720-69a054c2aebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe5040b-85f7-4d45-b720-69a054c2aebe', 'volume_size': 1}
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:05 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b39852d-f296-4ea3-9dee-35041c13cd05 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663" returned: 0 in 0.476s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:05 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:14:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:05 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663
Aug 26 03:14:05 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:06 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663" returned: 0 in 0.395s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:06 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info
Aug 26 03:14:06 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:06 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info" returned: 0 in 0.362s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:06 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:06 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info
Aug 26 03:14:06 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:06 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.info" returned: 0 in 0.312s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Acquiring lock "cinder-quobyte-a3f74944-94de-4950-95ac-cef0f7679551" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-a3f74944-94de-4950-95ac-cef0f7679551" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] snapshot: 26ecc1b4-c2f3-442b-805b-996a6b6e4663, volume: a3f74944-94de-4950-95ac-cef0f7679551,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd2efbb-ea61-4313-b122-ae064cba054e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:07 devstack sudo[105102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663
Aug 26 03:14:07 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:07 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663" returned: 0 in 0.506s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b39852d-f296-4ea3-9dee-35041c13cd05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ce400-cab2-4e93-b260-1ca1177e7ffb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:07 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05
Aug 26 03:14:07 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:07 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:14:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:07 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551
Aug 26 03:14:07 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:12 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:14:12 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:13 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.619s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:14:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:14:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:14:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:14:14 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551" returned: 0 in 6.614s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:14:14 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Converted 1024.00 MB image at 154.79 MB/s
Aug 26 03:14:14 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:14 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551
Aug 26 03:14:14 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:14 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551" returned: 0 in 0.252s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-a3f74944-94de-4950-95ac-cef0f7679551" released by "_copy_volume_from_snapshot" :: held 7.914s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Acquiring lock "cinder-quobyte-26ecc1b4-c2f3-442b-805b-996a6b6e4663" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-26ecc1b4-c2f3-442b-805b-996a6b6e4663" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Deleting offline snapshot 26ecc1b4-c2f3-442b-805b-996a6b6e4663 of volume 4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] snapshot_file for this snap is: volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e024ae3d-2d52-489d-b698-d82fbcfe6a77]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:14 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663
Aug 26 03:14:14 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:15 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663" returned: 0 in 0.473s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b39852d-f296-4ea3-9dee-35041c13cd05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:15 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceca99c-bf21-4809-be6a-1455bb98f70b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:15 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05
Aug 26 03:14:15 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:15 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05" returned: 0 in 0.644s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:16 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663
Aug 26 03:14:16 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=59,cinder:UPDATE=60,cinder:INSERT=23,cinder:DELETE=3 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:14:16 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663" returned: 0 in 0.397s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:16 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663
Aug 26 03:14:16 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:16 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05.26ecc1b4-c2f3-442b-805b-996a6b6e4663" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-26ecc1b4-c2f3-442b-805b-996a6b6e4663" released by "_delete_snapshot" :: held 2.026s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.880s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-70448d25-c440-492e-a539-6e9270435615 req-0b40c5a0-5e5f-409e-84f7-eeab3caee75d tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.817s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-70448d25-c440-492e-a539-6e9270435615 req-0b40c5a0-5e5f-409e-84f7-eeab3caee75d tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.435s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-454408721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe5040b-85f7-4d45-b720-69a054c2aebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad62a33f023462a86edd564302cd8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:05Z,use_quota=True,user_id='9d3f0dea130c48939ecb455da64730e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Creating volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:14:16 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:16 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe 1073741824
Aug 26 03:14:16 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-70448d25-c440-492e-a539-6e9270435615 req-0b40c5a0-5e5f-409e-84f7-eeab3caee75d tempest-TestInstancesWithCinderVolumes-4022716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcd64edc-126a-4eba-aea5-e8a84367bbed', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:14:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4596d3e7-9420-4878-bcc0-ab8a7e3002ed tempest-GroupsV314Test-123158151 None] Create group from source-group-3f1ab0df-e09a-4302-b928-63b9dd2aa811 completed successfully.
Aug 26 03:14:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-70448d25-c440-492e-a539-6e9270435615 req-0b40c5a0-5e5f-409e-84f7-eeab3caee75d tempest-TestInstancesWithCinderVolumes-4022716 None] attachment_update completed successfully.
Aug 26 03:14:17 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe 1073741824" returned: 0 in 0.502s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:17 devstack sudo[105273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe
Aug 26 03:14:17 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:17 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe" returned: 0 in 0.481s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba83d4b-da0a-4286-935e-f7a8860e4d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe5040b-85f7-4d45-b720-69a054c2aebe', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89c5140-715e-4f90-b56d-641044d4fce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:18 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Volume volume-efe5040b-85f7-4d45-b720-69a054c2aebe (efe5040b-85f7-4d45-b720-69a054c2aebe): created successfully
Aug 26 03:14:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89c5140-715e-4f90-b56d-641044d4fce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Flow 'volume_create_manager' (53f4ce39-b48b-44d0-9830-a8171fc0e57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-861ef872-39ef-408b-b8f8-6dddf0b4b2a1 tempest-SnapshotsActionsTest-493599830 None] Created volume successfully.
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Acquiring lock "cinder-quobyte-a3f74944-94de-4950-95ac-cef0f7679551" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-a3f74944-94de-4950-95ac-cef0f7679551" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[08735270-7c86-47ee-a83f-c6ff5118d706]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:19 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551
Aug 26 03:14:19 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Creating offline snapshot 22a98f4c-6168-456d-abc2-81226b233dc1 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9fd8c2-720f-4e90-b57c-fafc20f5145c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:19 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551" returned: 0 in 0.591s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:19 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe
Aug 26 03:14:19 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551
Aug 26 03:14:19 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:19 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:20 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a3f74944-94de-4950-95ac-cef0f7679551" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-a3f74944-94de-4950-95ac-cef0f7679551" released by "delete_volume" :: held 1.008s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:20 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe" returned: 0 in 0.527s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:20 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 1G
Aug 26 03:14:20 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Created reservations ['dc875246-1340-466b-802d-76031069294c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:20 devstack cinder-volume[94326]: WARNING cinder.quota [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-379658031 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-379658031, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:14:20 devstack cinder-volume[94326]: WARNING cinder.quota [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-379658031 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-379658031, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Created reservations ['0f45a70d-8d64-4ff2-808b-bc0abb0086a5', '9572d1b2-9827-4066-8b14-83919e100a7d', '545b453c-85fd-403a-aeb8-b2ac9c455948', '538120d8-e06b-4b37-90b0-d3ec78524002'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:20 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:14:20 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:20 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:14:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ff075c8b-1fda-4928-b0a9-db39c1f8e609 tempest-GroupsV314Test-123158151 None] Delete group completed successfully.
Aug 26 03:14:20 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 1G" returned: 0 in 0.616s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:20 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:20 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:21 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.418s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:21 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 is being set with open permissions: ugo+rw
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:21 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:21 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:21 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.431s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:21 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info
Aug 26 03:14:21 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Acquiring lock "cinder-quobyte-4b39852d-f296-4ea3-9dee-35041c13cd05" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-4b39852d-f296-4ea3-9dee-35041c13cd05" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5132ea3-f581-434f-8cf6-758cd4981b78]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:22 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05
Aug 26 03:14:22 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:22 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info" returned: 0 in 0.518s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:22 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info is being set with open permissions: ugo+rw
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:22 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info
Aug 26 03:14:22 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:22 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05" returned: 0 in 0.520s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:22 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05
Aug 26 03:14:22 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:22 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.info" returned: 0 in 0.517s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:22 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-21eb769a-255a-49cb-b562-73440fa01482 tempest-SnapshotsActionsTest-493599830 None] Create snapshot completed successfully
Aug 26 03:14:22 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4b39852d-f296-4ea3-9dee-35041c13cd05" returned: 0 in 0.460s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Lock "cinder-quobyte-4b39852d-f296-4ea3-9dee-35041c13cd05" released by "delete_volume" :: held 1.095s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Created reservations ['29671485-a234-4f60-a52c-2ff60a33ca70'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Created reservations ['1a1b51c8-2846-4813-9176-654fb6ae9b6f', 'a7072285-ff07-4578-917b-9571deeb206f', 'df151be9-5534-4ac7-badf-7d3d8061e1d0', 'f0e4fdca-717d-4c85-b25c-6821f58f9185'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:23 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:14:23 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:23 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:23 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:14:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0403d44a-e73f-48c2-b4ed-9c76a00e9e82 tempest-GroupsV314Test-123158151 None] Delete group completed successfully.
Aug 26 03:14:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Creating offline snapshot 8829cb22-e785-4405-bbc5-2f1b10872bb8 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:14:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51572dec-237e-493b-b27f-a481e31c9eee]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:25 devstack sudo[105766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:25 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:25 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.773s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:25 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 1G
Aug 26 03:14:25 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:26 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 1G" returned: 0 in 0.778s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:26 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8
Aug 26 03:14:26 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:27 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8" returned: 0 in 0.601s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:27 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 is being set with open permissions: ugo+rw
Aug 26 03:14:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:27 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8
Aug 26 03:14:27 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:27 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8" returned: 0 in 0.412s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-88dd6f4a-e8ef-44ce-ad3c-01c3a01c4e52 tempest-SnapshotsActionsTest-493599830 None] Create snapshot completed successfully
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-8829cb22-e785-4405-bbc5-2f1b10872bb8-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-8829cb22-e785-4405-bbc5-2f1b10872bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-8829cb22-e785-4405-bbc5-2f1b10872bb8" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-8829cb22-e785-4405-bbc5-2f1b10872bb8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Deleting offline snapshot 8829cb22-e785-4405-bbc5-2f1b10872bb8 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] snapshot_file for this snap is: volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30e30bc-3dec-491b-88ad-44e3c79a4816]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:28 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8
Aug 26 03:14:28 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:29 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8" returned: 0 in 0.492s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a515d9-949d-4fa7-ba88-6915ce1f65f3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:29 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:29 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:29 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.566s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:29 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8
Aug 26 03:14:29 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:30 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8" returned: 0 in 0.602s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:30 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8
Aug 26 03:14:30 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:30 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.8829cb22-e785-4405-bbc5-2f1b10872bb8" returned: 0 in 0.338s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-8829cb22-e785-4405-bbc5-2f1b10872bb8" released by "_delete_snapshot" :: held 2.177s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" released by "delete_snapshot" :: held 2.217s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Created reservations ['5fb75837-2512-4486-a1f9-75f972dd2681', '829facc8-d1e7-45d2-a2d2-4691614ad32c', '4e16f92b-aeec-43fe-93c4-be540f392e4c', '608af17c-6920-41e9-b870-78fe9f304e50'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Delete snapshot completed successfully.
Aug 26 03:14:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d6df558-fe2a-4cf7-bda3-6141ddb0721f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-8829cb22-e785-4405-bbc5-2f1b10872bb8-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Creating offline snapshot d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:14:32 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0fd4d-9b83-42bc-a531-69fc6cf97362]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:32 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:32 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:33 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.582s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:33 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 1G
Aug 26 03:14:33 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-78b0d472-0027-489f-973e-86b1cb589c51 tempest-GroupsV320Test-1685307118 None] Group tempest-GroupsV320Test-Group-768261554: creating
Aug 26 03:14:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-78b0d472-0027-489f-973e-86b1cb589c51 tempest-GroupsV320Test-1685307118 None] Group tempest-GroupsV320Test-Group-768261554: created successfully
Aug 26 03:14:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-78b0d472-0027-489f-973e-86b1cb589c51 tempest-GroupsV320Test-1685307118 None] Create group completed successfully.
Aug 26 03:14:33 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 1G" returned: 0 in 0.572s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:33 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8
Aug 26 03:14:33 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:33 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:33 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 is being set with open permissions: ugo+rw
Aug 26 03:14:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:34 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8
Aug 26 03:14:34 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:34 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" returned: 0 in 0.285s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d809dd84-e62f-41a2-ae00-5b55b3d850be tempest-SnapshotsActionsTest-493599830 None] Create snapshot completed successfully
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-d4149061-fdec-4f51-a2a9-69a6fc7cc3a8-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-d4149061-fdec-4f51-a2a9-69a6fc7cc3a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Deleting offline snapshot d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] snapshot_file for this snap is: volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9b34a-6d24-4892-b1af-0b7b43153dd3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:34 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8
Aug 26 03:14:34 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Created reservations ['e8e9edbf-2ace-4321-9278-98fd2680915d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:34 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:14:34 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:35 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" returned: 0 in 0.398s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[25268ced-3e6a-4bc5-8874-d0abf87ac25e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:35 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.261s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:14:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b4fd6c06-39b7-4daf-95cd-af565f44cac9 tempest-GroupsV320Test-1685307118 None] Delete group completed successfully.
Aug 26 03:14:35 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:35 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:35 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.383s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:35 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8
Aug 26 03:14:35 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:35 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" returned: 0 in 0.455s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:35 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8
Aug 26 03:14:35 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:36 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" returned: 0 in 0.416s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-d4149061-fdec-4f51-a2a9-69a6fc7cc3a8" released by "_delete_snapshot" :: held 1.769s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" released by "delete_snapshot" :: held 1.807s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Flow 'volume_create_manager' (91f97b4d-0615-4fac-9c0e-210c6a47ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6db335-a5a9-445b-9d53-a62c907315c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6db335-a5a9-445b-9d53-a62c907315c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-519832510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fe3b67-5593-47dc-b5de-275010daa9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7f79893ee4fb39dbb0a93fe1a56fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:36Z,use_quota=True,user_id='21145694fb904df188e47e6cf8b27ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755acfa7-d6f4-4b52-abe8-4c8bf9cda345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755acfa7-d6f4-4b52-abe8-4c8bf9cda345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09fc71e-05aa-41b9-85b0-6e2ff1337599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09fc71e-05aa-41b9-85b0-6e2ff1337599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fe3b67-5593-47dc-b5de-275010daa9a7', 'volume_name': 'volume-32fe3b67-5593-47dc-b5de-275010daa9a7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219df66-1fa2-49bc-9232-8c4b730029d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219df66-1fa2-49bc-9232-8c4b730029d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec54bbe-ad58-492c-8734-0634ace7b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:36 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Volume 32fe3b67-5593-47dc-b5de-275010daa9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fe3b67-5593-47dc-b5de-275010daa9a7', 'volume_size': 1}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-519832510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fe3b67-5593-47dc-b5de-275010daa9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7f79893ee4fb39dbb0a93fe1a56fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:36Z,use_quota=True,user_id='21145694fb904df188e47e6cf8b27ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Creating volume 32fe3b67-5593-47dc-b5de-275010daa9a7 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:14:36 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:36 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7 1073741824
Aug 26 03:14:36 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Created reservations ['666fd3f9-61de-4a9c-b40d-27ce68bcf895', '3cd75ced-b850-435e-b129-dbbfa31bb15d', 'ecf8bab7-2ba3-4d5c-be74-c509112015b2', '8e785799-be40-4072-82eb-bb9b13f07bca'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Delete snapshot completed successfully.
Aug 26 03:14:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-da067e25-ffaa-4a61-bffe-96f6e128e00f tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-d4149061-fdec-4f51-a2a9-69a6fc7cc3a8-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:37 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7 1073741824" returned: 0 in 0.510s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:37 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7
Aug 26 03:14:37 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:37 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7" returned: 0 in 0.294s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec54bbe-ad58-492c-8734-0634ace7b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fe3b67-5593-47dc-b5de-275010daa9a7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d308eda7-0979-4c2e-b168-0517357b3548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:14:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Volume volume-32fe3b67-5593-47dc-b5de-275010daa9a7 (32fe3b67-5593-47dc-b5de-275010daa9a7): created successfully
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d308eda7-0979-4c2e-b168-0517357b3548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:14:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Flow 'volume_create_manager' (91f97b4d-0615-4fac-9c0e-210c6a47ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:14:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ac60586f-ebc3-4c8a-8381-775f9a1300eb tempest-AttachVolumeNegativeTest-719800185 None] Created volume successfully.
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Creating offline snapshot 1134e585-0d45-472a-a854-be80b5399c43 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88bea9-5003-4325-8e3b-ab5687a19107]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:38 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:38 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:38 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.546s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:38 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 1G
Aug 26 03:14:38 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:39 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 1G" returned: 0 in 0.669s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:39 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43
Aug 26 03:14:39 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-1d7c9caa-f406-40b8-ae8a-97951a9a74cc req-da0e1901-dfa3-486c-8fa3-547348f3559b tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:39 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43" returned: 0 in 0.327s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:39 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 is being set with open permissions: ugo+rw
Aug 26 03:14:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:39 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43
Aug 26 03:14:39 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:40 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43" returned: 0 in 0.279s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=118,cinder:INSERT=24,cinder:UPDATE=112,cinder:DELETE=5 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-1d7c9caa-f406-40b8-ae8a-97951a9a74cc req-da0e1901-dfa3-486c-8fa3-547348f3559b tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-1d7c9caa-f406-40b8-ae8a-97951a9a74cc req-da0e1901-dfa3-486c-8fa3-547348f3559b tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-83109304-115d-4ae1-a9a9-bd2ae3581e9b tempest-SnapshotsActionsTest-493599830 None] Create snapshot completed successfully
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-1d7c9caa-f406-40b8-ae8a-97951a9a74cc req-da0e1901-dfa3-486c-8fa3-547348f3559b tempest-AttachVolumeNegativeTest-719800185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-32fe3b67-5593-47dc-b5de-275010daa9a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '757225f0-a812-4916-87ac-e09fa78e847b', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:14:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-1d7c9caa-f406-40b8-ae8a-97951a9a74cc req-da0e1901-dfa3-486c-8fa3-547348f3559b tempest-AttachVolumeNegativeTest-719800185 None] attachment_update completed successfully.
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-1134e585-0d45-472a-a854-be80b5399c43-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-1134e585-0d45-472a-a854-be80b5399c43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-1134e585-0d45-472a-a854-be80b5399c43" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-1134e585-0d45-472a-a854-be80b5399c43" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Deleting offline snapshot 1134e585-0d45-472a-a854-be80b5399c43 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] snapshot_file for this snap is: volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2fdb0c-b34e-49fd-a041-e24e86ad00f6]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:40 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43
Aug 26 03:14:40 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:41 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43" returned: 0 in 0.512s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7171a767-5720-43a4-974d-1f307253480a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:41 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:41 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:41 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:41 devstack sudo[106023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43
Aug 26 03:14:41 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:42 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43" returned: 0 in 0.485s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:42 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43
Aug 26 03:14:42 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:42 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.1134e585-0d45-472a-a854-be80b5399c43" returned: 0 in 0.257s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-1134e585-0d45-472a-a854-be80b5399c43" released by "_delete_snapshot" :: held 1.828s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" released by "delete_snapshot" :: held 1.857s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-534f1025-dd11-4a1f-9374-d7e5ff72e8fb req-76d731e7-60e8-4538-9531-0feed5969d3b tempest-AttachVolumeNegativeTest-719800185 None] Terminate volume connection completed successfully.
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-534f1025-dd11-4a1f-9374-d7e5ff72e8fb req-76d731e7-60e8-4538-9531-0feed5969d3b tempest-AttachVolumeNegativeTest-719800185 None] Deleting attachment 757225f0-a812-4916-87ac-e09fa78e847b. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Created reservations ['92e031bb-cda4-4d0e-a923-95889b3d8259', '0c266f5c-8e59-4f7d-a788-0aebb860f6ac', 'aa7339bd-16ef-435c-aa2e-e9a93144e4ed', 'a871070b-e198-4de6-a502-2b97e4492792'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Delete snapshot completed successfully.
Aug 26 03:14:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a1641012-a1f7-48f3-978f-296f0a857abe tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-1134e585-0d45-472a-a854-be80b5399c43-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Creating offline snapshot 5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f571aa-d82a-4054-942f-3e9e2d395475]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:43 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:43 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:43 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.427s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:43 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee 1G
Aug 26 03:14:43 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:44 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee 1G" returned: 0 in 0.676s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:44 devstack sudo[106071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee
Aug 26 03:14:44 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:44 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:44 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee is being set with open permissions: ugo+rw
Aug 26 03:14:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:44 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee
Aug 26 03:14:44 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:45 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0a43ef5e-4af9-44bf-b8ee-5f37914fe91b tempest-SnapshotsActionsTest-493599830 None] Create snapshot completed successfully
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Acquiring lock "cinder-quobyte-5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Deleting offline snapshot 5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] snapshot_file for this snap is: volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f8f63-115a-4577-8510-819217ba722e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:45 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee
Aug 26 03:14:45 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:45 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" returned: 0 in 0.409s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c1620-c41b-4125-bc25-8be72b2706fd]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:46 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:46 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:46 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.510s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:46 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee
Aug 26 03:14:46 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:46 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" returned: 0 in 0.421s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:46 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee
Aug 26 03:14:46 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:47 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee" released by "_delete_snapshot" :: held 1.767s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" released by "delete_snapshot" :: held 1.797s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Created reservations ['741a90af-1896-4c68-8a17-4dd49c92de25', '30b0136e-48a8-49e3-b6ce-6b6a49aa5c8b', '50ebd428-5c63-4333-a91e-218e62776658', '7c06f71a-3ed5-4127-9d6e-ee6cf07aadde'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Delete snapshot completed successfully.
Aug 26 03:14:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-686f72b7-d5d4-46fa-b88d-1f4ab77e769e tempest-SnapshotsActionsTest-2122658945 None] Lock "cinder-5c0326c4-f870-4cf8-9eaa-c3a3afeda6ee-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "cinder-22a98f4c-6168-456d-abc2-81226b233dc1-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-22a98f4c-6168-456d-abc2-81226b233dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "cinder-quobyte-22a98f4c-6168-456d-abc2-81226b233dc1" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-quobyte-22a98f4c-6168-456d-abc2-81226b233dc1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Deleting offline snapshot 22a98f4c-6168-456d-abc2-81226b233dc1 of volume efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] snapshot_file for this snap is: volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e420bbae-587b-4cc4-883c-942ac852c14e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:48 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:48 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:48 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.508s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe5040b-85f7-4d45-b720-69a054c2aebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff3ce9-6823-4093-8edf-eca48a791fd1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:49 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe
Aug 26 03:14:49 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:49 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe" returned: 0 in 0.506s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:49 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:49 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:49 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.530s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:49 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1
Aug 26 03:14:49 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:50 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe.22a98f4c-6168-456d-abc2-81226b233dc1" returned: 0 in 0.455s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-quobyte-22a98f4c-6168-456d-abc2-81226b233dc1" released by "_delete_snapshot" :: held 2.184s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" released by "delete_snapshot" :: held 2.223s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Created reservations ['a879ed6f-d554-42be-9070-57671398c95c', 'aa94357f-63a0-4a30-a1b6-1bbb54052d54', '45d0ce5b-12af-4c84-bc78-c91ccb034793', '8dadae0d-efd0-4750-91dc-b51cbc3ffd13'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Delete snapshot completed successfully.
Aug 26 03:14:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b013311e-42b6-48a5-9e58-4c6d170a2f3a tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-22a98f4c-6168-456d-abc2-81226b233dc1-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "cinder-efe5040b-85f7-4d45-b720-69a054c2aebe-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-efe5040b-85f7-4d45-b720-69a054c2aebe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:14:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:14:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4000ce26-f789-4359-9557-142dce784610]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:14:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:51 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe
Aug 26 03:14:51 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:52 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe" returned: 0 in 0.498s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:52 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe
Aug 26 03:14:52 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:52 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-efe5040b-85f7-4d45-b720-69a054c2aebe" returned: 0 in 0.393s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-quobyte-efe5040b-85f7-4d45-b720-69a054c2aebe" released by "delete_volume" :: held 1.010s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Created reservations ['33f4d2a6-6c8b-476e-bfe3-f9931331fa36', 'a31ab339-eb80-4120-96bb-79bcb9419628', '3fda3694-fe49-49f5-8871-9c1b51b360a8', '937f98bb-75ad-4532-8e7f-88dacf142331'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:14:52 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:14:52 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-df7df19c-38d5-4dc0-be01-fc11f73d31ec req-4638e7e3-b646-4e2c-8336-bdae68e992cb tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-df7df19c-38d5-4dc0-be01-fc11f73d31ec req-4638e7e3-b646-4e2c-8336-bdae68e992cb tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-df7df19c-38d5-4dc0-be01-fc11f73d31ec req-4638e7e3-b646-4e2c-8336-bdae68e992cb tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-df7df19c-38d5-4dc0-be01-fc11f73d31ec req-4638e7e3-b646-4e2c-8336-bdae68e992cb tempest-TestInstancesWithCinderVolumes-4022716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bf3f230-de2c-4c43-b105-5e0190821843', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:14:53 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:14:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Deleted volume successfully.
Aug 26 03:14:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-df7df19c-38d5-4dc0-be01-fc11f73d31ec req-4638e7e3-b646-4e2c-8336-bdae68e992cb tempest-TestInstancesWithCinderVolumes-4022716 None] attachment_update completed successfully.
Aug 26 03:14:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c1afc35-f777-421c-8265-b844c37a0614 tempest-SnapshotsActionsTest-493599830 None] Lock "cinder-efe5040b-85f7-4d45-b720-69a054c2aebe-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:14:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b3880057-3fed-49d6-9dbb-182737ae24d5 req-2a4bf7ef-f9ad-47a7-a08a-eb10671e4b1a tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:14:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b3880057-3fed-49d6-9dbb-182737ae24d5 req-2a4bf7ef-f9ad-47a7-a08a-eb10671e4b1a tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:14:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b3880057-3fed-49d6-9dbb-182737ae24d5 req-2a4bf7ef-f9ad-47a7-a08a-eb10671e4b1a tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:14:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-b3880057-3fed-49d6-9dbb-182737ae24d5 req-2a4bf7ef-f9ad-47a7-a08a-eb10671e4b1a tempest-TestInstancesWithCinderVolumes-4022716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-58445eea-584e-42dc-8d06-261ad5f9183c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd2f49bd-ee04-49a6-98ba-1504020a5cbd', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:14:56 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-b3880057-3fed-49d6-9dbb-182737ae24d5 req-2a4bf7ef-f9ad-47a7-a08a-eb10671e4b1a tempest-TestInstancesWithCinderVolumes-4022716 None] attachment_update completed successfully.
Aug 26 03:15:04 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-312f8810-4d05-419e-bb34-453d73f230b4 req-118a777e-62d0-4880-8ecd-903794dc1e8a tempest-TestInstancesWithCinderVolumes-4022716 None] Terminate volume connection completed successfully.
Aug 26 03:15:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-312f8810-4d05-419e-bb34-453d73f230b4 req-118a777e-62d0-4880-8ecd-903794dc1e8a tempest-TestInstancesWithCinderVolumes-4022716 None] Deleting attachment 6bf3f230-de2c-4c43-b105-5e0190821843. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:15:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "cinder-b4d22d4e-722e-4dcd-b9e3-81e7292830b5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-b4d22d4e-722e-4dcd-b9e3-81e7292830b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "cinder-quobyte-b4d22d4e-722e-4dcd-b9e3-81e7292830b5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-quobyte-b4d22d4e-722e-4dcd-b9e3-81e7292830b5" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:05 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b0811f-ed77-459a-971d-b9fbfd8676fa]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:05 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5
Aug 26 03:15:05 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:05 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5" returned: 0 in 0.609s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:05 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5
Aug 26 03:15:05 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:06 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b4d22d4e-722e-4dcd-b9e3-81e7292830b5" returned: 0 in 0.385s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-quobyte-b4d22d4e-722e-4dcd-b9e3-81e7292830b5" released by "delete_volume" :: held 1.096s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:06 devstack cinder-volume[94326]: WARNING cinder.quota [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306295977-922942654 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306295977-922942654, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:06 devstack cinder-volume[94326]: WARNING cinder.quota [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306295977-922942654 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1306295977-922942654, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Created reservations ['9bf23b0e-b6eb-419a-9620-1a805e4555a5', '443cc0d9-52d9-481b-85ca-b747d1cd08c3', 'd53ad2d6-e6e3-460a-b4a2-f25e94f19075', '865e7597-6e39-4d29-8673-0f66281ee710'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:06 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:06 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:07 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.761s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Deleted volume successfully.
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d2b17492-52a7-4e89-bbbc-1c27e79bcadd tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-b4d22d4e-722e-4dcd-b9e3-81e7292830b5-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Flow 'volume_create_manager' (1dae9266-20b8-4ba4-8f9a-e9b9814f496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b06b4d-c845-4228-a175-fa08b25a0661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b06b4d-c845-4228-a175-fa08b25a0661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-222233933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25765b54-195d-4551-a507-2497f0cc439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03df47b20684b0f83ba82c8c5bf64ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:08Z,use_quota=True,user_id='c6e077285ab1471e8156cb7c42cc92fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6107efa2-2b6d-4ac1-979a-0c14f04f2c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6107efa2-2b6d-4ac1-979a-0c14f04f2c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc66a68e-1891-496f-9c5c-251cfcfbf903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc66a68e-1891-496f-9c5c-251cfcfbf903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25765b54-195d-4551-a507-2497f0cc439f', 'volume_name': 'volume-25765b54-195d-4551-a507-2497f0cc439f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507c4eac-5550-4762-9c8a-61fb79116760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (507c4eac-5550-4762-9c8a-61fb79116760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e96436-a2ce-4630-a457-d6bd1bee2594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:07 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Volume 25765b54-195d-4551-a507-2497f0cc439f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25765b54-195d-4551-a507-2497f0cc439f', 'volume_size': 1}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-222233933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25765b54-195d-4551-a507-2497f0cc439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03df47b20684b0f83ba82c8c5bf64ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:08Z,use_quota=True,user_id='c6e077285ab1471e8156cb7c42cc92fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Creating volume 25765b54-195d-4551-a507-2497f0cc439f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:07 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:07 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f 1073741824
Aug 26 03:15:07 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:08 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f 1073741824" returned: 0 in 0.844s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:08 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f
Aug 26 03:15:08 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:09 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f" returned: 0 in 0.358s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e96436-a2ce-4630-a457-d6bd1bee2594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25765b54-195d-4551-a507-2497f0cc439f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a404ee-5fef-4d51-8e68-b6fb7fa63777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Volume volume-25765b54-195d-4551-a507-2497f0cc439f (25765b54-195d-4551-a507-2497f0cc439f): created successfully
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a404ee-5fef-4d51-8e68-b6fb7fa63777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Flow 'volume_create_manager' (1dae9266-20b8-4ba4-8f9a-e9b9814f496d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1880fc46-cab3-401f-a474-3303bfa18dcc tempest-VolumeQuotasAdminTestJSON-400510702 None] Created volume successfully.
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "cinder-25765b54-195d-4551-a507-2497f0cc439f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "cinder-25765b54-195d-4551-a507-2497f0cc439f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "cinder-quobyte-25765b54-195d-4551-a507-2497f0cc439f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "cinder-quobyte-25765b54-195d-4551-a507-2497f0cc439f" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a423576-4e96-4845-b0f8-36b2ff1e4d43]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:10 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f
Aug 26 03:15:10 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:10 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f" returned: 0 in 0.532s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:10 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f
Aug 26 03:15:10 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:10 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-25765b54-195d-4551-a507-2497f0cc439f" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "cinder-quobyte-25765b54-195d-4551-a507-2497f0cc439f" released by "delete_volume" :: held 0.904s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:10 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Created reservations ['9b81f472-2fd6-4d06-813a-a86b2ad00ae8', 'b60a2a2c-4893-40bf-8400-5b5ccaccb288', '7a1eeb1a-2e05-4aeb-877c-419c03e611e6', 'b52d2ccd-6a0f-4889-adb6-412cfd8f556c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:11 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:11 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-ee501960-2628-48a0-a264-b825c5044f01 req-65eb4cf1-bcbe-43c8-a09a-9473983ddfd7 tempest-TestInstancesWithCinderVolumes-4022716 None] Terminate volume connection completed successfully.
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-ee501960-2628-48a0-a264-b825c5044f01 req-65eb4cf1-bcbe-43c8-a09a-9473983ddfd7 tempest-TestInstancesWithCinderVolumes-4022716 None] Deleting attachment cd2f49bd-ee04-49a6-98ba-1504020a5cbd. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:15:11 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Deleted volume successfully.
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-108627e4-f356-43f6-a293-a508e1c64213 tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "cinder-25765b54-195d-4551-a507-2497f0cc439f-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "cinder-58445eea-584e-42dc-8d06-261ad5f9183c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-58445eea-584e-42dc-8d06-261ad5f9183c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "cinder-quobyte-58445eea-584e-42dc-8d06-261ad5f9183c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-quobyte-58445eea-584e-42dc-8d06-261ad5f9183c" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda7de0e-029a-4bbe-a91a-ad25132a54f0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Flow 'volume_create_manager' (1e265618-449f-4ec8-88ec-5865932d49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c34897-0449-4d0c-9ad7-0f77140eb54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c34897-0449-4d0c-9ad7-0f77140eb54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1930782685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ab778f-a395-4f10-9bf6-f853bfb57019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03df47b20684b0f83ba82c8c5bf64ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:12Z,use_quota=True,user_id='c6e077285ab1471e8156cb7c42cc92fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a905b40e-638a-4d8f-9900-4cafefe5e77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a905b40e-638a-4d8f-9900-4cafefe5e77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723574d0-57aa-49b0-9366-fa122497c7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723574d0-57aa-49b0-9366-fa122497c7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ab778f-a395-4f10-9bf6-f853bfb57019', 'volume_name': 'volume-f6ab778f-a395-4f10-9bf6-f853bfb57019', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107e460f-25eb-4a50-a164-c9f7d1606c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107e460f-25eb-4a50-a164-c9f7d1606c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e26fd8c-be65-43f1-86bc-69699b2d4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:12 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Volume f6ab778f-a395-4f10-9bf6-f853bfb57019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ab778f-a395-4f10-9bf6-f853bfb57019', 'volume_size': 1}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1930782685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ab778f-a395-4f10-9bf6-f853bfb57019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a03df47b20684b0f83ba82c8c5bf64ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:12Z,use_quota=True,user_id='c6e077285ab1471e8156cb7c42cc92fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Creating volume f6ab778f-a395-4f10-9bf6-f853bfb57019 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:12 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:12 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 1073741824
Aug 26 03:15:12 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:12 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c
Aug 26 03:15:12 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:12 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c" returned: 0 in 0.587s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:12 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c
Aug 26 03:15:12 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:12 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:12 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:12 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 1073741824" returned: 0 in 0.745s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:12 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019
Aug 26 03:15:12 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:12 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.399s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:15:13 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-58445eea-584e-42dc-8d06-261ad5f9183c" returned: 0 in 0.607s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-quobyte-58445eea-584e-42dc-8d06-261ad5f9183c" released by "delete_volume" :: held 1.266s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:13 devstack cinder-volume[94326]: WARNING cinder.quota [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061878795-592576840 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061878795-592576840, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:13 devstack cinder-volume[94326]: WARNING cinder.quota [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061878795-592576840 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061878795-592576840, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Created reservations ['5ee9a3b0-7d73-41bb-ad93-ce0f556169a9', 'fb152115-c48b-444b-b5bc-240d3f3a9279', '3475a828-3ec0-4d1f-8d07-40fbc7d73a5a', 'aed119e4-0b6a-4773-a794-056135e5765d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:13 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019" returned: 0 in 0.369s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e26fd8c-be65-43f1-86bc-69699b2d4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ab778f-a395-4f10-9bf6-f853bfb57019', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cff89a3-8cb9-41ae-ba69-1fe7e2f6672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Volume volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 (f6ab778f-a395-4f10-9bf6-f853bfb57019): created successfully
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cff89a3-8cb9-41ae-ba69-1fe7e2f6672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Flow 'volume_create_manager' (1e265618-449f-4ec8-88ec-5865932d49b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b3de708e-89b3-4fc4-aa8c-c8dbbf6c74ab tempest-VolumeQuotasAdminTestJSON-400510702 None] Created volume successfully.
Aug 26 03:15:13 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:13 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:13 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.328s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Deleted volume successfully.
Aug 26 03:15:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8628ece8-9cd8-4a5a-acb0-1e78d0669e25 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-58445eea-584e-42dc-8d06-261ad5f9183c-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5e173e6f-6a54-4ba7-8ced-2737afaf1db5 tempest-VolumeQuotasAdminTestJSON-1281286990 None] Transfer volume completed successfully.
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Acquiring lock "cinder-f6ab778f-a395-4f10-9bf6-f853bfb57019-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Lock "cinder-f6ab778f-a395-4f10-9bf6-f853bfb57019-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=104,cinder:SELECT=119,cinder:INSERT=26,cinder:DELETE=7 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Acquiring lock "cinder-quobyte-f6ab778f-a395-4f10-9bf6-f853bfb57019" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Lock "cinder-quobyte-f6ab778f-a395-4f10-9bf6-f853bfb57019" acquired by "delete_volume" :: waited 0.055s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0639cb-7f17-4f8e-a7c9-b8cd1f14f685]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:16 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019
Aug 26 03:15:16 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:17 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019" returned: 0 in 0.932s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:17 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019
Aug 26 03:15:17 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:17 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6ab778f-a395-4f10-9bf6-f853bfb57019" returned: 0 in 0.375s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Lock "cinder-quobyte-f6ab778f-a395-4f10-9bf6-f853bfb57019" released by "delete_volume" :: held 1.374s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Created reservations ['5fa79adb-5231-4d98-9d88-d060b0f19345', '58783103-0162-477a-9778-512c89bbeda3', '007420c2-e103-4cdb-af23-8553a55c6c3e', 'ad11cc94-117d-412f-976e-8e013fd7c059'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:17 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:17 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:18 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:18 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Deleted volume successfully.
Aug 26 03:15:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62bdb9da-80f7-4fe8-b36c-d34d5517a01a tempest-VolumeQuotasAdminTestJSON-2029919548 None] Lock "cinder-f6ab778f-a395-4f10-9bf6-f853bfb57019-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-461733c5-a1ce-49e8-8cd8-55b361214dec req-7875a9b3-2108-474f-81a0-77a1ccd664d3 tempest-TestInstancesWithCinderVolumes-4022716 None] Terminate volume connection completed successfully.
Aug 26 03:15:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-461733c5-a1ce-49e8-8cd8-55b361214dec req-7875a9b3-2108-474f-81a0-77a1ccd664d3 tempest-TestInstancesWithCinderVolumes-4022716 None] Deleting attachment fcd64edc-126a-4eba-aea5-e8a84367bbed. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:15:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "cinder-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "cinder-quobyte-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-quobyte-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:20 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a83e0-6313-4608-9beb-1dc4feba1bf4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:20 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82
Aug 26 03:15:20 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:21 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" returned: 0 in 0.464s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:21 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82
Aug 26 03:15:21 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:21 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" returned: 0 in 0.299s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-quobyte-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82" released by "delete_volume" :: held 0.819s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:21 devstack cinder-volume[94326]: WARNING cinder.quota [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2051601457-880049227 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2051601457-880049227, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:21 devstack cinder-volume[94326]: WARNING cinder.quota [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2051601457-880049227 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2051601457-880049227, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Created reservations ['e47dbfcd-56c4-4fe2-a55d-89d5198fc95d', '0bee29e9-5a6e-4c35-bbc5-ee46cb89f78c', '13b9c04d-6da9-4164-b46b-da459fa0175c', '3fbe28a2-276b-4b26-a8a4-50b567788039'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:21 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:21 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:22 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:22 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:22 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Deleted volume successfully.
Aug 26 03:15:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aac7c312-9cb0-4de9-9fc9-d9b4ad81b031 tempest-TestInstancesWithCinderVolumes-4022716 None] Lock "cinder-2b5bc3e0-db5d-4de2-a53c-53c4d5ac1c82-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Flow 'volume_create_manager' (6fdb2f75-4223-459e-9bea-39f8eebd3381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500c88d8-e995-42b7-bf40-0086ce557808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500c88d8-e995-42b7-bf40-0086ce557808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-127326495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7a7c93-330a-4d4f-8ad8-9cc96466e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78203aa6b46e4125a468259ca4f953b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:24Z,use_quota=True,user_id='568333b27cea48a0b786caf0f5959759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a3e62f-d837-4212-8835-895aa8f03e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a3e62f-d837-4212-8835-895aa8f03e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2c833b-96ce-408b-a4c4-682f0dc73a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2c833b-96ce-408b-a4c4-682f0dc73a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7a7c93-330a-4d4f-8ad8-9cc96466e293', 'volume_name': 'volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1326c940-70b1-484b-bc7a-3f0a7e30a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1326c940-70b1-484b-bc7a-3f0a7e30a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83eabea-b4d5-48c8-95fa-21a23d15961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:24 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Volume 1c7a7c93-330a-4d4f-8ad8-9cc96466e293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293', 'volume_size': 1}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-127326495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7a7c93-330a-4d4f-8ad8-9cc96466e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78203aa6b46e4125a468259ca4f953b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:24Z,use_quota=True,user_id='568333b27cea48a0b786caf0f5959759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Creating volume 1c7a7c93-330a-4d4f-8ad8-9cc96466e293 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:24 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:24 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 1073741824
Aug 26 03:15:24 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:25 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 1073741824" returned: 0 in 0.633s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:25 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293
Aug 26 03:15:25 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:25 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83eabea-b4d5-48c8-95fa-21a23d15961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9830ed-b804-4042-883e-799077521616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:25 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Volume volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 (1c7a7c93-330a-4d4f-8ad8-9cc96466e293): created successfully
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9830ed-b804-4042-883e-799077521616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Flow 'volume_create_manager' (6fdb2f75-4223-459e-9bea-39f8eebd3381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-52731835-758d-4b28-b5af-80912b3a42a9 tempest-AbsoluteLimitsTests-1156529289 None] Created volume successfully.
Aug 26 03:15:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Acquiring lock "cinder-1c7a7c93-330a-4d4f-8ad8-9cc96466e293-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Lock "cinder-1c7a7c93-330a-4d4f-8ad8-9cc96466e293-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Acquiring lock "cinder-quobyte-1c7a7c93-330a-4d4f-8ad8-9cc96466e293" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Lock "cinder-quobyte-1c7a7c93-330a-4d4f-8ad8-9cc96466e293" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d78792-4d5f-4a77-9def-3b40e90c9d43]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:27 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293
Aug 26 03:15:27 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:27 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293" returned: 0 in 0.477s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:27 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293
Aug 26 03:15:27 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:27 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1c7a7c93-330a-4d4f-8ad8-9cc96466e293" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Lock "cinder-quobyte-1c7a7c93-330a-4d4f-8ad8-9cc96466e293" released by "delete_volume" :: held 0.894s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Flow 'volume_create_manager' (d685462e-2e38-4f6c-b0c8-e42dda582297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d75da8-e207-4414-a838-01899c6a88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Created reservations ['8f0585ef-f01a-42c7-8b4f-0425b5e34022', '140a2d4d-72d1-4835-9aa1-4b5bb76f77a8', '6f57ca39-1fc4-4b3b-b944-8ff636f22dbc', 'd560eaf7-c33c-4653-9f05-f34598fe0cb8'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d75da8-e207-4414-a838-01899c6a88b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-975316268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bad8c7-bd72-42b6-921e-8d59c43501a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99bb14c745a47e682c35314a4cfac9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:28Z,use_quota=True,user_id='92cbdd9f9116405bbd58babeeecee1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc0161-8767-4830-81d6-2b207eaf8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc0161-8767-4830-81d6-2b207eaf8727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a3179f-f648-4814-aa57-6b4c2770ce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a3179f-f648-4814-aa57-6b4c2770ce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9bad8c7-bd72-42b6-921e-8d59c43501a9', 'volume_name': 'volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776665f8-dac6-48d2-abb7-16de539cebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776665f8-dac6-48d2-abb7-16de539cebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af64967b-7a95-4d19-a55e-8082a4d8c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:27 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Volume d9bad8c7-bd72-42b6-921e-8d59c43501a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9', 'volume_size': 1}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-975316268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bad8c7-bd72-42b6-921e-8d59c43501a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99bb14c745a47e682c35314a4cfac9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:28Z,use_quota=True,user_id='92cbdd9f9116405bbd58babeeecee1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Creating volume d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:27 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:28 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 1073741824
Aug 26 03:15:28 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Flow 'volume_create_manager' (136b79ae-5536-4f40-8e39-5f8bc7c60d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741ed21e-7c7c-4c6f-9984-8cadd9e6f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741ed21e-7c7c-4c6f-9984-8cadd9e6f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-969663866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc7ce91-7426-46ed-9141-c7c53ea4b581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7f79893ee4fb39dbb0a93fe1a56fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:28Z,use_quota=True,user_id='21145694fb904df188e47e6cf8b27ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f42eacf-9bd5-4bd3-9bed-30db0ba7f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f42eacf-9bd5-4bd3-9bed-30db0ba7f21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c740d1-95ca-4026-8f56-5acb1dc809fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c740d1-95ca-4026-8f56-5acb1dc809fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc7ce91-7426-46ed-9141-c7c53ea4b581', 'volume_name': 'volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8344b382-603e-46c7-b451-6c52be2b87e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8344b382-603e-46c7-b451-6c52be2b87e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5ef1bc-2d7b-4133-81c5-93427c3f3baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Volume ccc7ce91-7426-46ed-9141-c7c53ea4b581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581', 'volume_size': 1}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:28 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:28 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:28 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Deleted volume successfully.
Aug 26 03:15:28 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 1073741824" returned: 0 in 0.622s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f343769f-e107-4d3d-9348-ff900de987c2 tempest-AbsoluteLimitsTests-1156529289 None] Lock "cinder-1c7a7c93-330a-4d4f-8ad8-9cc96466e293-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:28 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9
Aug 26 03:15:28 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:28 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9" returned: 0 in 0.278s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-969663866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc7ce91-7426-46ed-9141-c7c53ea4b581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c7f79893ee4fb39dbb0a93fe1a56fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:28Z,use_quota=True,user_id='21145694fb904df188e47e6cf8b27ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Creating volume ccc7ce91-7426-46ed-9141-c7c53ea4b581 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:28 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af64967b-7a95-4d19-a55e-8082a4d8c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:28 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 1073741824
Aug 26 03:15:28 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf8d333-b7fe-4a95-9507-a6da7b91c42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Volume volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 (d9bad8c7-bd72-42b6-921e-8d59c43501a9): created successfully
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf8d333-b7fe-4a95-9507-a6da7b91c42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Flow 'volume_create_manager' (d685462e-2e38-4f6c-b0c8-e42dda582297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-aa1c6322-a88c-4837-b726-1b7d0ec67609 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Created volume successfully.
Aug 26 03:15:29 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 1073741824" returned: 0 in 0.503s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:29 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581
Aug 26 03:15:29 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:29 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5ef1bc-2d7b-4133-81c5-93427c3f3baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d405f2c-7eeb-470a-bc3a-5c4b73126014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:29 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Volume volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 (ccc7ce91-7426-46ed-9141-c7c53ea4b581): created successfully
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d405f2c-7eeb-470a-bc3a-5c4b73126014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Flow 'volume_create_manager' (136b79ae-5536-4f40-8e39-5f8bc7c60d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9684a4a9-8767-403b-a387-1fd000fb1285 tempest-AttachVolumeNegativeTest-719800185 None] Created volume successfully.
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Creating offline snapshot 1df5d9ff-75d4-4ccc-9b97-032a335a0456 of volume d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:15:30 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3117c0d-69bb-4d6f-9d9f-da9efcf07a2e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:30 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9
Aug 26 03:15:30 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:30 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9" returned: 0 in 0.418s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:30 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 1G
Aug 26 03:15:30 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:31 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 1G" returned: 0 in 0.555s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:31 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456
Aug 26 03:15:31 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:31 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456" returned: 0 in 0.476s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:31 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 is being set with open permissions: ugo+rw
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:31 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456
Aug 26 03:15:31 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b57ea24b-9270-4ca1-a80f-597ffd8866e1 req-8dc1efc7-db2f-4f44-a38b-b42787245703 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:31 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:31 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info
Aug 26 03:15:31 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:32 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info" returned: 0 in 0.315s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:32 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info is being set with open permissions: ugo+rw
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:32 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info
Aug 26 03:15:32 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:32 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.info" returned: 0 in 0.278s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b57ea24b-9270-4ca1-a80f-597ffd8866e1 req-8dc1efc7-db2f-4f44-a38b-b42787245703 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.683s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-b57ea24b-9270-4ca1-a80f-597ffd8866e1 req-8dc1efc7-db2f-4f44-a38b-b42787245703 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-67278ca7-1090-43e8-b766-cf6dd088a3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Create snapshot completed successfully
Aug 26 03:15:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-b57ea24b-9270-4ca1-a80f-597ffd8866e1 req-8dc1efc7-db2f-4f44-a38b-b42787245703 tempest-AttachVolumeNegativeTest-719800185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f30d3001-7322-40aa-a664-0a2527bc9dc7', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:15:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-b57ea24b-9270-4ca1-a80f-597ffd8866e1 req-8dc1efc7-db2f-4f44-a38b-b42787245703 tempest-AttachVolumeNegativeTest-719800185 None] attachment_update completed successfully.
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "cinder-1df5d9ff-75d4-4ccc-9b97-032a335a0456-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-1df5d9ff-75d4-4ccc-9b97-032a335a0456-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "cinder-quobyte-d9bad8c7-bd72-42b6-921e-8d59c43501a9" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-quobyte-d9bad8c7-bd72-42b6-921e-8d59c43501a9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "cinder-quobyte-1df5d9ff-75d4-4ccc-9b97-032a335a0456" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-quobyte-1df5d9ff-75d4-4ccc-9b97-032a335a0456" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Deleting offline snapshot 1df5d9ff-75d4-4ccc-9b97-032a335a0456 of volume d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] snapshot_file for this snap is: volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[148e27f8-9b00-4840-b4ca-4876bc0341b2]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:34 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456
Aug 26 03:15:34 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:34 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456" returned: 0 in 0.473s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:15:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[07edc5a9-3fd4-435d-bf0c-b6dc17f68dd7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:34 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9
Aug 26 03:15:34 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:34 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9" returned: 0 in 0.461s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:35 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456
Aug 26 03:15:35 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Flow 'volume_create_manager' (61f4e52e-ef82-402f-974b-dc7f93403036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73db14a2-c3ce-4b85-a5ef-51e7d15d6e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73db14a2-c3ce-4b85-a5ef-51e7d15d6e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-108314431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b5f7ab-e9da-4700-93ad-cee35720d510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3ed4c74a42cba3351f632c8bfafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:35Z,use_quota=True,user_id='51a3158e1d1c41cb80e211f94b731a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc8619b-bf64-4cdd-bcd7-c634b7775a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc8619b-bf64-4cdd-bcd7-c634b7775a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1507a34-88c2-4dd3-9b3b-1ace8592781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1507a34-88c2-4dd3-9b3b-1ace8592781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b5f7ab-e9da-4700-93ad-cee35720d510', 'volume_name': 'volume-32b5f7ab-e9da-4700-93ad-cee35720d510', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3949246c-cef9-43af-b4b9-e865b76cfd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3949246c-cef9-43af-b4b9-e865b76cfd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63042e6c-3ee0-4790-9c28-7eed82deea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:35 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Volume 32b5f7ab-e9da-4700-93ad-cee35720d510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b5f7ab-e9da-4700-93ad-cee35720d510', 'volume_size': 1}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-108314431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b5f7ab-e9da-4700-93ad-cee35720d510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3ed4c74a42cba3351f632c8bfafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:35Z,use_quota=True,user_id='51a3158e1d1c41cb80e211f94b731a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Creating volume 32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:35 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:35 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 1073741824
Aug 26 03:15:35 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:35 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456" returned: 0 in 0.581s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:35 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456
Aug 26 03:15:35 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:35 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9.1df5d9ff-75d4-4ccc-9b97-032a335a0456" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-quobyte-1df5d9ff-75d4-4ccc-9b97-032a335a0456" released by "_delete_snapshot" :: held 1.997s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-quobyte-d9bad8c7-bd72-42b6-921e-8d59c43501a9" released by "delete_snapshot" :: held 2.027s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:35 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 1073741824" returned: 0 in 0.653s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Created reservations ['0add08f7-cb9d-4ac3-b884-ee920f753307', '0e7dbb79-0e54-4ec6-9290-ecb9cd3f35cc', '6e4fd917-12ae-4956-a37f-7bc578be0930', '75b37322-15ad-41aa-92e0-965ea1058c49'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:36 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:36 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-2073206d-8992-45e4-ad1a-0b7bf49a1b7c req-f8982925-9d15-47a0-a2cc-9ae3932e91cb tempest-AttachVolumeNegativeTest-719800185 None] Terminate volume connection completed successfully.
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-2073206d-8992-45e4-ad1a-0b7bf49a1b7c req-f8982925-9d15-47a0-a2cc-9ae3932e91cb tempest-AttachVolumeNegativeTest-719800185 None] Deleting attachment f30d3001-7322-40aa-a664-0a2527bc9dc7. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:15:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Delete snapshot completed successfully.
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b92bb396-c630-415a-8910-e2714d34d61c tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-1df5d9ff-75d4-4ccc-9b97-032a335a0456-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:36 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.319s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63042e6c-3ee0-4790-9c28-7eed82deea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b5f7ab-e9da-4700-93ad-cee35720d510', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f249037-abb9-4eb4-ab96-9d44518d55a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:36 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Volume volume-32b5f7ab-e9da-4700-93ad-cee35720d510 (32b5f7ab-e9da-4700-93ad-cee35720d510): created successfully
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f249037-abb9-4eb4-ab96-9d44518d55a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Flow 'volume_create_manager' (61f4e52e-ef82-402f-974b-dc7f93403036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b1f47087-a96c-4a0c-b28b-f7029c10a88f tempest-VolumesDeleteCascade-2001468301 None] Created volume successfully.
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "cinder-d9bad8c7-bd72-42b6-921e-8d59c43501a9-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-d9bad8c7-bd72-42b6-921e-8d59c43501a9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "cinder-quobyte-d9bad8c7-bd72-42b6-921e-8d59c43501a9" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-quobyte-d9bad8c7-bd72-42b6-921e-8d59c43501a9" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c21c2-9a04-4faf-931e-adb463f6b758]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:37 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9
Aug 26 03:15:37 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Creating offline snapshot 404bc81f-a2b5-4de4-887a-3ddf936ca88b of volume 32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c77b928-a429-4f89-91d6-0e7554a57e38]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:37 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:37 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:38 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9" returned: 0 in 0.589s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:38 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9
Aug 26 03:15:38 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:38 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.653s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:38 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9bad8c7-bd72-42b6-921e-8d59c43501a9" returned: 0 in 0.350s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:38 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b 1G
Aug 26 03:15:38 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-quobyte-d9bad8c7-bd72-42b6-921e-8d59c43501a9" released by "delete_volume" :: held 1.123s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Created reservations ['310ddef1-026d-4acd-9cee-97d08d2b311c', '583ce565-2388-4ff3-8936-c8c43a6426e0', '39fa4435-f9c5-486c-8992-4cf4003902cc', 'b89f2e6a-d1ee-4bec-b4b2-6f8039bc500b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:38 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:38 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:38 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b 1G" returned: 0 in 0.519s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:38 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:38 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:39 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.329s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Deleted volume successfully.
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c9ece24-8904-4947-8eee-9767652b2204 tempest-VolumeSnapshotQuotasNegativeTestJSON-89044348 None] Lock "cinder-d9bad8c7-bd72-42b6-921e-8d59c43501a9-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:39 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.357s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:39 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b is being set with open permissions: ugo+rw
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:39 devstack sudo[107079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:39 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:39 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.393s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:39 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info
Aug 26 03:15:39 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:40 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:40 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info is being set with open permissions: ugo+rw
Aug 26 03:15:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:40 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info
Aug 26 03:15:40 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:40 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.info" returned: 0 in 0.300s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:40 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:DELETE=12,cinder:UPDATE=110,cinder:SELECT=109,cinder:INSERT=30 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:15:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bca9cec1-7e78-471a-8499-c2b7a1ecb978 tempest-VolumesDeleteCascade-2001468301 None] Create snapshot completed successfully
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Creating offline snapshot a3584491-ecf9-4f8b-82bd-76611609618b of volume 32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf69c15-88d4-4551-8fa4-509c38e18fbb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:41 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:41 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:41 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.418s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b5f7ab-e9da-4700-93ad-cee35720d510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:15:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:41 devstack sudo[107130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b 1G
Aug 26 03:15:41 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "cinder-ccc7ce91-7426-46ed-9141-c7c53ea4b581-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:42 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-ccc7ce91-7426-46ed-9141-c7c53ea4b581-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b 1G" returned: 0 in 0.524s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:42 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b
Aug 26 03:15:42 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "cinder-quobyte-ccc7ce91-7426-46ed-9141-c7c53ea4b581" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-quobyte-ccc7ce91-7426-46ed-9141-c7c53ea4b581" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09ea96-0703-4eb4-ace9-7d622bd454ce]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:42 devstack sudo[107138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581
Aug 26 03:15:42 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:42 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b" returned: 0 in 0.407s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:42 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b is being set with open permissions: ugo+rw
Aug 26 03:15:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:42 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b
Aug 26 03:15:42 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:43 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:43 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581" returned: 0 in 0.596s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b" returned: 0 in 0.322s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:43 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581
Aug 26 03:15:43 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1ae788a2-7398-4792-a823-5a38dda2fc57 tempest-VolumesDeleteCascade-2001468301 None] Create snapshot completed successfully
Aug 26 03:15:43 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ccc7ce91-7426-46ed-9141-c7c53ea4b581" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-quobyte-ccc7ce91-7426-46ed-9141-c7c53ea4b581" released by "delete_volume" :: held 1.032s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-32b5f7ab-e9da-4700-93ad-cee35720d510-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-32b5f7ab-e9da-4700-93ad-cee35720d510-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Created reservations ['a7144120-b7c7-47b3-8e59-bbfc9d28c6d5', 'bbe95a7a-f02f-4cb2-be3a-218da25b4e56', '717c6d1c-d29e-4f23-a9b0-3295692b4f4e', 'cc0f5914-665f-42eb-8910-0a15d5b7f6b3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Performing cascade delete. {{(pid=94326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-404bc81f-a2b5-4de4-887a-3ddf936ca88b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-404bc81f-a2b5-4de4-887a-3ddf936ca88b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-404bc81f-a2b5-4de4-887a-3ddf936ca88b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:43 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:43 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-404bc81f-a2b5-4de4-887a-3ddf936ca88b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Deleting offline snapshot 404bc81f-a2b5-4de4-887a-3ddf936ca88b of volume 32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] snapshot_file for this snap is: volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd85883-706d-4e33-95f7-4aff9a769d23]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:44 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:44 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:44 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.342s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Deleted volume successfully.
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3530f589-c66b-4d74-82ec-e50d5f98b57f tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-ccc7ce91-7426-46ed-9141-c7c53ea4b581-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:44 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.511s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b5f7ab-e9da-4700-93ad-cee35720d510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d59282-7348-4364-b00f-83c34f80c660]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:44 devstack sudo[107161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:44 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "cinder-32fe3b67-5593-47dc-b5de-275010daa9a7-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-32fe3b67-5593-47dc-b5de-275010daa9a7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "cinder-quobyte-32fe3b67-5593-47dc-b5de-275010daa9a7" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-quobyte-32fe3b67-5593-47dc-b5de-275010daa9a7" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e405c6f-4b6c-42cc-896e-05b7f3f0a812]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:45 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.646s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:45 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7
Aug 26 03:15:45 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e583c1-cf58-4de8-9c38-cf9c5dd8cd4f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:45 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b
Aug 26 03:15:45 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:45 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7" returned: 0 in 0.499s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:45 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7
Aug 26 03:15:45 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:45 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b" returned: 0 in 0.480s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b5f7ab-e9da-4700-93ad-cee35720d510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b19a677-6791-4973-9c92-48f7fa74c172]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:45 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32fe3b67-5593-47dc-b5de-275010daa9a7" returned: 0 in 0.361s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-quobyte-32fe3b67-5593-47dc-b5de-275010daa9a7" released by "delete_volume" :: held 0.926s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:45 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:45 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Created reservations ['ed0c42ee-8d60-4d9a-9294-f29f24079e65', 'd94fc156-f9f7-4bb7-adc7-8605e3309f14', '434576bf-3f29-4787-a453-bf318ca8675f', '1cad9abe-097b-4727-ba0d-1392eccfdc4f'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:46 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.592s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b5f7ab-e9da-4700-93ad-cee35720d510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[23327b75-fd79-4f18-81af-4d270eb9172b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:46 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:46 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:46 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:46 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:46 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.557s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:46 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:46 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:46 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Deleted volume successfully.
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f633516b-e999-41f6-b4ef-e6b56257e5b0 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-32fe3b67-5593-47dc-b5de-275010daa9a7-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:47 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.501s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:47 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b
Aug 26 03:15:47 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "cinder-76179496-2208-4507-aa25-7efe9084ee5b-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-76179496-2208-4507-aa25-7efe9084ee5b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "cinder-quobyte-76179496-2208-4507-aa25-7efe9084ee5b" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-quobyte-76179496-2208-4507-aa25-7efe9084ee5b" acquired by "delete_volume" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0956e8-8c9e-4771-96c9-0f9ec7b99943]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:47 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:47 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.404bc81f-a2b5-4de4-887a-3ddf936ca88b" returned: 0 in 0.469s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b -F qcow2 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:47 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:47 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b -F qcow2
Aug 26 03:15:47 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:48 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b" returned: 0 in 0.523s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:48 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b
Aug 26 03:15:48 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:48 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b5f7ab-e9da-4700-93ad-cee35720d510 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b -F qcow2" returned: 0 in 0.444s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-404bc81f-a2b5-4de4-887a-3ddf936ca88b" released by "_delete_snapshot" :: held 4.512s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" released by "delete_snapshot" :: held 4.542s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Created reservations ['05783f66-7c0e-484e-9751-016a8169350e', 'a00a8414-6115-46c9-8e12-a1beaaabc384', '134df352-3f2c-4184-bd3b-3718d9811c97', 'e2a9aaaf-c03d-46ea-847f-72837da80d22'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Delete snapshot completed successfully.
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-404bc81f-a2b5-4de4-887a-3ddf936ca88b-delete_snapshot" released by "delete_snapshot" :: held 4.800s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-a3584491-ecf9-4f8b-82bd-76611609618b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-a3584491-ecf9-4f8b-82bd-76611609618b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:48 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76179496-2208-4507-aa25-7efe9084ee5b" returned: 0 in 0.416s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-a3584491-ecf9-4f8b-82bd-76611609618b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-quobyte-76179496-2208-4507-aa25-7efe9084ee5b" released by "delete_volume" :: held 1.006s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a3584491-ecf9-4f8b-82bd-76611609618b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Deleting offline snapshot a3584491-ecf9-4f8b-82bd-76611609618b of volume 32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] snapshot_file for this snap is: volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353c627-6e8f-4589-98bc-0225f46f9b76]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Created reservations ['e0d154f9-10b1-4716-8dbc-dbec3d2492cb', '9cd13596-7f95-4eff-9e20-cb48da6fb638', 'bbc024f7-82d7-4948-924a-eaf692e47c60', '9d3f4aec-5a11-46e6-b4de-254dae832b2a'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:48 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b
Aug 26 03:15:48 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:49 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:49 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:49 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b" returned: 0 in 0.555s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b5f7ab-e9da-4700-93ad-cee35720d510(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5fbd5e-1ebe-4188-8dab-3ec4710df6e2]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:49 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.436s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Deleted volume successfully.
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6cb7b1b-e677-4431-af8f-ca978e94b3e9 tempest-AttachVolumeNegativeTest-719800185 None] Lock "cinder-76179496-2208-4507-aa25-7efe9084ee5b-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:49 devstack sudo[107230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:49 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Flow 'volume_create_manager' (8e7df70e-64ca-4a01-b258-99121d91989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f1f694-409f-4a0f-b87d-d269df8accca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f1f694-409f-4a0f-b87d-d269df8accca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1488031327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f68851e-f297-4aae-8eef-f6065558f0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e980853509ea482bacb1ee41ca5f2178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:50Z,use_quota=True,user_id='a18c04f14cbd405fa305c61cb1661879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c9da380-2097-4dcd-8eea-58745543b16f),volume_type_id=6c9da380-2097-4dcd-8eea-58745543b16f)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0631e7-9381-40dd-a696-5fe2fc615826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0631e7-9381-40dd-a696-5fe2fc615826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a6a971-8f45-4aab-b371-1a396df4e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a6a971-8f45-4aab-b371-1a396df4e064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f68851e-f297-4aae-8eef-f6065558f0bb', 'volume_name': 'volume-6f68851e-f297-4aae-8eef-f6065558f0bb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bced6d65-b590-4a91-87e8-318c3725d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bced6d65-b590-4a91-87e8-318c3725d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecb3136-a5dd-40e2-bb3c-8e9ffd63b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:49 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Volume 6f68851e-f297-4aae-8eef-f6065558f0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f68851e-f297-4aae-8eef-f6065558f0bb', 'volume_size': 1}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1488031327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f68851e-f297-4aae-8eef-f6065558f0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e980853509ea482bacb1ee41ca5f2178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:50Z,use_quota=True,user_id='a18c04f14cbd405fa305c61cb1661879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c9da380-2097-4dcd-8eea-58745543b16f),volume_type_id=6c9da380-2097-4dcd-8eea-58745543b16f)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Creating volume 6f68851e-f297-4aae-8eef-f6065558f0bb {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:49 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:49 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb 1073741824
Aug 26 03:15:49 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:49 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.577s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:49 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b
Aug 26 03:15:49 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:50 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb 1073741824" returned: 0 in 0.624s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:50 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b" returned: 0 in 0.489s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:50 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb
Aug 26 03:15:50 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:50 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b
Aug 26 03:15:50 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:50 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecb3136-a5dd-40e2-bb3c-8e9ffd63b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f68851e-f297-4aae-8eef-f6065558f0bb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71f3ce8-590e-475a-af39-ac6fd7f836f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:50 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Volume volume-6f68851e-f297-4aae-8eef-f6065558f0bb (6f68851e-f297-4aae-8eef-f6065558f0bb): created successfully
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71f3ce8-590e-475a-af39-ac6fd7f836f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:50 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Flow 'volume_create_manager' (8e7df70e-64ca-4a01-b258-99121d91989c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510.a3584491-ecf9-4f8b-82bd-76611609618b" returned: 0 in 0.389s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-903643cb-0f6f-4eae-aa27-c4ff5e27ec82 tempest-VolumeTypesAccessTest-1031058068 None] Created volume successfully.
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a3584491-ecf9-4f8b-82bd-76611609618b" released by "_delete_snapshot" :: held 2.173s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" released by "delete_snapshot" :: held 2.216s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Created reservations ['72f8c8c6-661b-4b69-a13a-11c04e24e247', '7dd54d1e-1622-48f2-9481-5a92686f42ee', '0af79d38-45c5-4a0e-bcca-0be66242d81a', 'ffc8723c-2248-4da4-b401-e25fbcd5dce4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:51 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Delete snapshot completed successfully.
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-a3584491-ecf9-4f8b-82bd-76611609618b-delete_snapshot" released by "delete_snapshot" :: held 2.404s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Snapshots deleted, issuing volume delete {{(pid=94326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e9747-024b-4a7e-84c2-772886a1c7d7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:51 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:51 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:51 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.424s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:51 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510
Aug 26 03:15:51 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:51 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Acquiring lock "cinder-6f68851e-f297-4aae-8eef-f6065558f0bb-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-32b5f7ab-e9da-4700-93ad-cee35720d510" returned: 0 in 0.370s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-32b5f7ab-e9da-4700-93ad-cee35720d510" released by "delete_volume" :: held 0.881s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Lock "cinder-6f68851e-f297-4aae-8eef-f6065558f0bb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Acquiring lock "cinder-quobyte-6f68851e-f297-4aae-8eef-f6065558f0bb" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Lock "cinder-quobyte-6f68851e-f297-4aae-8eef-f6065558f0bb" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Created reservations ['a2ef8b83-ab8a-4d53-8985-ddfac22f5474', 'bd8f02c9-6b34-4fcf-ba47-f6e4bff9b71e', '345f0b70-bb08-4c51-8549-e5d79756456f', '694dc069-e48a-491e-9b5c-8b57e7ef1521'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f61b6b-c1d0-4f9a-a0f5-4792ea9a2e6a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:52 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:52 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:52 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb
Aug 26 03:15:52 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:52 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.322s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Deleted volume successfully.
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-847e834d-36d7-49a7-be64-431788f2c856 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-32b5f7ab-e9da-4700-93ad-cee35720d510-delete_volume" released by "delete_volume" :: held 8.827s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:52 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb" returned: 0 in 0.491s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:52 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb
Aug 26 03:15:52 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:52 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6f68851e-f297-4aae-8eef-f6065558f0bb" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Lock "cinder-quobyte-6f68851e-f297-4aae-8eef-f6065558f0bb" released by "delete_volume" :: held 0.981s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:53 devstack cinder-volume[94326]: WARNING cinder.quota [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1936897422 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1936897422, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:53 devstack cinder-volume[94326]: WARNING cinder.quota [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1936897422 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1936897422, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Created reservations ['d3e4b326-7cfe-4cb8-963f-bb2da5802093', '17834871-e6ad-48d1-9254-e73fe65a7fe8', '86e46406-18dc-487a-acf4-7658ef1a8f4c', '37df2113-f6e5-453f-b5c3-11b6545de0ea'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:53 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:15:53 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Flow 'volume_create_manager' (682faadd-1862-480b-b675-11608f505b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2f6dd8-919b-49c3-9d48-74e8551721a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2f6dd8-919b-49c3-9d48-74e8551721a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-672903301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b0deb4-a77f-4fae-b71b-669b7664dc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3ed4c74a42cba3351f632c8bfafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:53Z,use_quota=True,user_id='51a3158e1d1c41cb80e211f94b731a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94611084-d13d-483f-8d43-7aeeeee1349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94611084-d13d-483f-8d43-7aeeeee1349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95278db-5de2-43b5-827d-c913a73b800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95278db-5de2-43b5-827d-c913a73b800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b0deb4-a77f-4fae-b71b-669b7664dc8a', 'volume_name': 'volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becd2374-563b-4097-9b81-8742ce93d7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becd2374-563b-4097-9b81-8742ce93d7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96eb09fe-e82a-4ed9-9adb-9c81d5372b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:53 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Volume 91b0deb4-a77f-4fae-b71b-669b7664dc8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a', 'volume_size': 1}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-672903301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b0deb4-a77f-4fae-b71b-669b7664dc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3ed4c74a42cba3351f632c8bfafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:53Z,use_quota=True,user_id='51a3158e1d1c41cb80e211f94b731a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Creating volume 91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:15:53 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:53 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a 1073741824
Aug 26 03:15:53 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:53 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.502s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:15:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Deleted volume successfully.
Aug 26 03:15:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a5250191-59b6-45a1-8ae3-2d8ba79ccd7f tempest-VolumeTypesAccessTest-1031058068 None] Lock "cinder-6f68851e-f297-4aae-8eef-f6065558f0bb-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:15:54 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a 1073741824" returned: 0 in 0.576s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:54 devstack sudo[107286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a
Aug 26 03:15:54 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:54 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a" returned: 0 in 0.466s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96eb09fe-e82a-4ed9-9adb-9c81d5372b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e761ab3-fa27-4a12-bdc8-159b70b64742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:15:54 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Volume volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a (91b0deb4-a77f-4fae-b71b-669b7664dc8a): created successfully
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e761ab3-fa27-4a12-bdc8-159b70b64742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:15:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Flow 'volume_create_manager' (682faadd-1862-480b-b675-11608f505b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:15:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d915500d-612c-43c6-ad5e-0b1c4e5bc534 tempest-VolumesDeleteCascade-2001468301 None] Created volume successfully.
Aug 26 03:15:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:15:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:15:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Creating offline snapshot a72db247-8de8-4f5a-87a6-c9089bf32522 of volume 91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:15:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a348833-28d9-455c-9453-b56514c199c6]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:15:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:56 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a
Aug 26 03:15:56 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:56 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:56 devstack sudo[107295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 1G
Aug 26 03:15:56 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:57 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 1G" returned: 0 in 0.521s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:57 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522
Aug 26 03:15:57 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:57 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522" returned: 0 in 0.361s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:57 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 is being set with open permissions: ugo+rw
Aug 26 03:15:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:57 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522
Aug 26 03:15:57 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:57 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522" returned: 0 in 0.337s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:57 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info
Aug 26 03:15:57 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:58 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info" returned: 0 in 0.294s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:58 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info is being set with open permissions: ugo+rw
Aug 26 03:15:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:15:58 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info
Aug 26 03:15:58 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:15:58 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Aug 26 03:15:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.info" returned: 0 in 0.348s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:15:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:15:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d76ba0ea-631e-4051-b3cd-f6fb8697a52b tempest-VolumesDeleteCascade-2001468301 None] Create snapshot completed successfully
Aug 26 03:15:59 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Flow 'volume_create_manager' (0eb01338-6690-4090-b5cc-1decc9d58814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92302a0a-bcce-449b-8bf9-4ff31a34adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92302a0a-bcce-449b-8bf9-4ff31a34adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-528239335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fd5287-8e08-4a30-9d3d-551f7b0224df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3ed4c74a42cba3351f632c8bfafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a72db247-8de8-4f5a-87a6-c9089bf32522,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:00Z,use_quota=True,user_id='51a3158e1d1c41cb80e211f94b731a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3f4302-abad-4768-8977-27aa44e92087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3f4302-abad-4768-8977-27aa44e92087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9844357-2652-462f-b936-a8831ebb4511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9844357-2652-462f-b936-a8831ebb4511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9fd5287-8e08-4a30-9d3d-551f7b0224df', 'volume_name': 'volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df', 'volume_size': 1, 'snapshot_id': 'a72db247-8de8-4f5a-87a6-c9089bf32522'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da29a5e7-383d-41e5-b939-e1bc1c085667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da29a5e7-383d-41e5-b939-e1bc1c085667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f5e2c-6579-4ada-9e4e-80d40e7a45c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Volume a9fd5287-8e08-4a30-9d3d-551f7b0224df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df', 'volume_size': 1, 'snapshot_id': 'a72db247-8de8-4f5a-87a6-c9089bf32522'}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-a72db247-8de8-4f5a-87a6-c9089bf32522-a9fd5287-8e08-4a30-9d3d-551f7b0224df" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a72db247-8de8-4f5a-87a6-c9089bf32522-a9fd5287-8e08-4a30-9d3d-551f7b0224df" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Creating volume a9fd5287-8e08-4a30-9d3d-551f7b0224df from snapshot a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-a9fd5287-8e08-4a30-9d3d-551f7b0224df" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a9fd5287-8e08-4a30-9d3d-551f7b0224df" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] snapshot: a72db247-8de8-4f5a-87a6-c9089bf32522, volume: a9fd5287-8e08-4a30-9d3d-551f7b0224df,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c193c6-037f-4850-909a-4f7e5b54cea0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:00 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522
Aug 26 03:16:00 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:00 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522" returned: 0 in 0.587s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47944d1-a3e6-49c2-a6d0-ebe842450c6c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:01 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a
Aug 26 03:16:01 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:01 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:16:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:16:01 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:16:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:01 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df
Aug 26 03:16:01 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4e4d6249-4675-45cf-a4d7-4ce0e93871ad tempest-GroupSnapshotsV319Test-34955716 None] Group tempest-GroupSnapshotsV319Test-Group-1449932337: creating
Aug 26 03:16:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4e4d6249-4675-45cf-a4d7-4ce0e93871ad tempest-GroupSnapshotsV319Test-34955716 None] Group tempest-GroupSnapshotsV319Test-Group-1449932337: created successfully
Aug 26 03:16:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4e4d6249-4675-45cf-a4d7-4ce0e93871ad tempest-GroupSnapshotsV319Test-34955716 None] Create group completed successfully.
Aug 26 03:16:04 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Flow 'volume_create_manager' (1a0a3583-fccd-499a-b599-0de3340fb495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817c5514-2a5e-44be-8561-b971e9ebe8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817c5514-2a5e-44be-8561-b971e9ebe8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245205869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2d95b18a-a3fd-4e2d-813a-abfc8c165a49,host='devstack@QuobyteHD#QuobyteHD',id=76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722e564d75724da48c31978b09a0c4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:05Z,use_quota=True,user_id='9093cf6bccf641ef87474dc66c5811a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6cc21e1-5d58-4161-932c-fa6b7dbc22aa),volume_type_id=c6cc21e1-5d58-4161-932c-fa6b7dbc22aa)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce21c289-ee7e-4bc3-b445-6ff915a903bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce21c289-ee7e-4bc3-b445-6ff915a903bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07214442-74aa-4198-88f0-3dda7bbcd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07214442-74aa-4198-88f0-3dda7bbcd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2', 'volume_name': 'volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66148778-f1de-4ce7-a2cc-730f5a3ebf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66148778-f1de-4ce7-a2cc-730f5a3ebf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8facd9-98ea-4bf7-a527-5340688da962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Volume 76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2', 'volume_size': 1}
Aug 26 03:16:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:07 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df" returned: 0 in 6.061s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:16:07 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Converted 1024.00 MB image at 168.91 MB/s
Aug 26 03:16:07 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df is being set with open permissions: ugo+rw
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:07 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df
Aug 26 03:16:07 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:07 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a9fd5287-8e08-4a30-9d3d-551f7b0224df" released by "_copy_volume_from_snapshot" :: held 7.592s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a72db247-8de8-4f5a-87a6-c9089bf32522-a9fd5287-8e08-4a30-9d3d-551f7b0224df" released by "_create_volume_from_snapshot" :: held 7.680s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.700s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2d95b18a-a3fd-4e2d-813a-abfc8c165a49,created_at=2026-08-26T01:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245205869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2d95b18a-a3fd-4e2d-813a-abfc8c165a49,host='devstack@QuobyteHD#QuobyteHD',id=76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722e564d75724da48c31978b09a0c4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:05Z,use_quota=True,user_id='9093cf6bccf641ef87474dc66c5811a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6cc21e1-5d58-4161-932c-fa6b7dbc22aa),volume_type_id=c6cc21e1-5d58-4161-932c-fa6b7dbc22aa)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Creating volume 76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:07 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:07 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 1073741824
Aug 26 03:16:07 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140f5e2c-6579-4ada-9e4e-80d40e7a45c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df', 'volume_size': 1, 'snapshot_id': 'a72db247-8de8-4f5a-87a6-c9089bf32522'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145f4b2c-15f7-47b6-8786-bf1d399a50fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:07 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Volume volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df (a9fd5287-8e08-4a30-9d3d-551f7b0224df): created successfully
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145f4b2c-15f7-47b6-8786-bf1d399a50fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Flow 'volume_create_manager' (0eb01338-6690-4090-b5cc-1decc9d58814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-82c93b6f-0020-478c-a3c3-c5b9ccc3435a tempest-VolumesDeleteCascade-2001468301 None] Created volume successfully.
Aug 26 03:16:08 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 1073741824" returned: 0 in 0.528s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:08 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2
Aug 26 03:16:08 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:08 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" returned: 0 in 0.335s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8facd9-98ea-4bf7-a527-5340688da962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795082c2-a2e5-4b7a-a11c-f6f667b8bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Volume volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 (76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2): created successfully
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795082c2-a2e5-4b7a-a11c-f6f667b8bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Flow 'volume_create_manager' (1a0a3583-fccd-499a-b599-0de3340fb495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c795b0e6-7c76-4420-9804-42167efbac4d tempest-GroupSnapshotsV319Test-34955716 None] Created volume successfully.
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-91b0deb4-a77f-4fae-b71b-669b7664dc8a-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-91b0deb4-a77f-4fae-b71b-669b7664dc8a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Flow 'volume_create_manager' (61a51c22-e21b-49de-a14a-355998eb0684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91aeefd-c04f-46a7-8bf3-24b0cbd3eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Performing cascade delete. {{(pid=94326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-a72db247-8de8-4f5a-87a6-c9089bf32522-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91aeefd-c04f-46a7-8bf3-24b0cbd3eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1957172873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bef320a-2d66-4bb2-867c-ebb9e9f3727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e496ff567515433ba2abfa36491c8da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:09Z,use_quota=True,user_id='0f03471522c74317abe4051db36b4dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d0f3b-d321-48e3-b953-c7658a232eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d0f3b-d321-48e3-b953-c7658a232eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03c5fa8-4272-4fc5-9a7d-d0aa39c42b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03c5fa8-4272-4fc5-9a7d-d0aa39c42b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bef320a-2d66-4bb2-867c-ebb9e9f3727a', 'volume_name': 'volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8561eb11-b1eb-4a7c-aa56-78a2dd472b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8561eb11-b1eb-4a7c-aa56-78a2dd472b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fc6acc-30a5-4ab1-9f51-802c68398c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Volume 6bef320a-2d66-4bb2-867c-ebb9e9f3727a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a', 'volume_size': 1}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1957172873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bef320a-2d66-4bb2-867c-ebb9e9f3727a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e496ff567515433ba2abfa36491c8da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:09Z,use_quota=True,user_id='0f03471522c74317abe4051db36b4dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Creating volume 6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:09 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-a72db247-8de8-4f5a-87a6-c9089bf32522-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:09 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a 1073741824
Aug 26 03:16:09 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-91b0deb4-a77f-4fae-b71b-669b7664dc8a" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-91b0deb4-a77f-4fae-b71b-669b7664dc8a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-a72db247-8de8-4f5a-87a6-c9089bf32522" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a72db247-8de8-4f5a-87a6-c9089bf32522" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Deleting offline snapshot a72db247-8de8-4f5a-87a6-c9089bf32522 of volume 91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] snapshot_file for this snap is: volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d4c541-be2a-4b8c-9da9-d7bcad31bf5b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:09 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522
Aug 26 03:16:09 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:09 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a 1073741824" returned: 0 in 0.480s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:09 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522" returned: 0 in 0.420s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[47301595-99bf-4380-9f38-1fdc09307400]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:10 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a
Aug 26 03:16:10 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:10 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a
Aug 26 03:16:10 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:10 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] GroupSnapshot 05cec93a-edd3-487c-b5d7-eb41aa6064e1: creating.
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8fc6acc-30a5-4ab1-9f51-802c68398c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fef4c13-ca34-4d49-a635-a1ed0f975f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Group snapshot 05cec93a-edd3-487c-b5d7-eb41aa6064e1: creating. {{(pid=94326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Volume volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a (6bef320a-2d66-4bb2-867c-ebb9e9f3727a): created successfully
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fef4c13-ca34-4d49-a635-a1ed0f975f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Flow 'volume_create_manager' (61a51c22-e21b-49de-a14a-355998eb0684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Creating offline snapshot 6baea9d0-ec62-43a9-ae39-632e9374de08 of volume 76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:16:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-eafe73aa-5da8-4d0a-b565-4d417ccec95c tempest-SnapshotMetadataTestJSON-825878122 None] Created volume successfully.
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae351bac-a9bf-418e-88d4-0f79b902b4b0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:10 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2
Aug 26 03:16:10 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:10 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a" returned: 0 in 0.701s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:10 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522
Aug 26 03:16:10 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:10 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" returned: 0 in 0.405s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:10 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 1G
Aug 26 03:16:10 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:11 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:11 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522
Aug 26 03:16:11 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:11 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a.a72db247-8de8-4f5a-87a6-c9089bf32522" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:11 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 1G" returned: 0 in 0.499s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a72db247-8de8-4f5a-87a6-c9089bf32522" released by "_delete_snapshot" :: held 1.896s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-91b0deb4-a77f-4fae-b71b-669b7664dc8a" released by "delete_snapshot" :: held 1.925s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:11 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08
Aug 26 03:16:11 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Created reservations ['ef0ee235-3027-427d-a766-80712d9e7f40', '262d509d-ff01-43e8-9eb0-06fd218c6600', '2020f3c3-5fe4-41aa-83bb-6bd3318fbd5a', 'a9417022-0f3d-4bd5-a020-20d3eab7c6bc'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Delete snapshot completed successfully.
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-a72db247-8de8-4f5a-87a6-c9089bf32522-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Snapshots deleted, issuing volume delete {{(pid=94326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-91b0deb4-a77f-4fae-b71b-669b7664dc8a" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-91b0deb4-a77f-4fae-b71b-669b7664dc8a" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eef985-cdaa-46bb-9676-c90de179f4df]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:11 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08" returned: 0 in 0.422s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:11 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:16:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:11 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08
Aug 26 03:16:11 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:11 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a
Aug 26 03:16:11 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:12 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info
Aug 26 03:16:12 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a" returned: 0 in 0.402s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:12 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a
Aug 26 03:16:12 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info" returned: 0 in 0.278s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:12 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:12 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info
Aug 26 03:16:12 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-91b0deb4-a77f-4fae-b71b-669b7664dc8a" returned: 0 in 0.285s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-91b0deb4-a77f-4fae-b71b-669b7664dc8a" released by "delete_volume" :: held 0.754s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Created reservations ['2d2296b6-9698-4cab-89dd-bcd70418d779', 'e3bfe0f5-bfa4-4426-b8f9-a2f24a813bea', '12369814-126f-4fdf-b266-6493fed7bbb3', '001a897c-4d5c-40f0-be39-b6e22f092865'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:12 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:12 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:12 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:12 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.info" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.984s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Creating offline snapshot 25399fdf-7ed3-43e0-9606-f87ebc8cacda of volume 6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfedda3f-c3b3-4126-b064-b9cb55ecebc9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-a9fd5287-8e08-4a30-9d3d-551f7b0224df-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d359405-a4eb-4372-bcce-e677b9ec43dc tempest-GroupSnapshotsV319Test-34955716 None] group_snapshot 05cec93a-edd3-487c-b5d7-eb41aa6064e1: created successfully
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-a9fd5287-8e08-4a30-9d3d-551f7b0224df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:12 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:12 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:16:12 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "cinder-quobyte-a9fd5287-8e08-4a30-9d3d-551f7b0224df" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a9fd5287-8e08-4a30-9d3d-551f7b0224df" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[657dc12f-0603-4bc6-a5bf-bacca2e490a1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:13 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.434s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Deleted volume successfully.
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2d714a3b-10b7-464c-9fbc-9df1e9f17951 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-91b0deb4-a77f-4fae-b71b-669b7664dc8a-delete_volume" released by "delete_volume" :: held 3.840s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:13 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df
Aug 26 03:16:13 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:13 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" returned: 0 in 0.520s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:13 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda 1G
Aug 26 03:16:13 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:13 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:13 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df
Aug 26 03:16:13 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:13 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a9fd5287-8e08-4a30-9d3d-551f7b0224df" returned: 0 in 0.296s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-quobyte-a9fd5287-8e08-4a30-9d3d-551f7b0224df" released by "delete_volume" :: held 0.790s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:13 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda 1G" returned: 0 in 0.503s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:13 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda
Aug 26 03:16:13 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Created reservations ['c8c9d4c0-f6c1-4bf5-8d52-ff689e09675a', '961bed33-8f81-4a9f-9a0e-cde373486534', 'f548b93a-4cec-4be5-9e81-b3e6e5bd730a', 'b1083dff-e013-456f-8793-5fd8f000fc50'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:14 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:14 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:14 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda" returned: 0 in 0.442s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:14 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda is being set with open permissions: ugo+rw
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:14 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda
Aug 26 03:16:14 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] group_snapshot 05cec93a-edd3-487c-b5d7-eb41aa6064e1: deleting
Aug 26 03:16:14 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.395s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Deleted volume successfully.
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] group_snapshot 05cec93a-edd3-487c-b5d7-eb41aa6064e1: deleting {{(pid=94326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-742d66cb-8636-46e0-8d28-31d8add07a05 tempest-VolumesDeleteCascade-2001468301 None] Lock "cinder-a9fd5287-8e08-4a30-9d3d-551f7b0224df-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "cinder-quobyte-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Lock "cinder-quobyte-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "cinder-quobyte-6baea9d0-ec62-43a9-ae39-632e9374de08" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Lock "cinder-quobyte-6baea9d0-ec62-43a9-ae39-632e9374de08" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Deleting offline snapshot 6baea9d0-ec62-43a9-ae39-632e9374de08 of volume 76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] snapshot_file for this snap is: volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71eb33d-d4c4-45d5-a994-d72fbb36c658]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:14 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda" returned: 0 in 0.485s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:14 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08
Aug 26 03:16:14 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:14 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info
Aug 26 03:16:14 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:15 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08" returned: 0 in 0.541s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadeb643-a496-4cf1-b003-e0cd5a6fd2eb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:15 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:15 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info is being set with open permissions: ugo+rw
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:15 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info
Aug 26 03:16:15 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:15 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2
Aug 26 03:16:15 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:15 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.info" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bb7c01f5-c912-4742-8abd-d54d7a0fb59a tempest-SnapshotMetadataTestJSON-825878122 None] Create snapshot completed successfully
Aug 26 03:16:15 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" returned: 0 in 0.714s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:16 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08
Aug 26 03:16:16 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:16 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08" returned: 0 in 0.662s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:16 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08
Aug 26 03:16:16 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:16 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2.6baea9d0-ec62-43a9-ae39-632e9374de08" returned: 0 in 0.307s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Lock "cinder-quobyte-6baea9d0-ec62-43a9-ae39-632e9374de08" released by "_delete_snapshot" :: held 2.391s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Lock "cinder-quobyte-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" released by "delete_snapshot" :: held 2.426s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=136,cinder:INSERT=37,cinder:UPDATE=163,cinder:DELETE=9 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:16:17 devstack cinder-volume[94326]: WARNING cinder.quota [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-948953385 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-948953385, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:16:17 devstack cinder-volume[94326]: WARNING cinder.quota [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-948953385 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-948953385, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] Created reservations ['2aeeb07a-c59f-42d7-8f54-90c818b2f955', '967a9943-b3e8-4293-a505-ecc952518566', 'db04e317-a5a7-4ff8-931d-87e4c03dfdab', '4e63a6e0-2e5d-4423-b3c6-f82e69b5f601'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "cinder-25399fdf-7ed3-43e0-9606-f87ebc8cacda-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8d5ddaac-5f01-4c8f-bed4-dea9d36b989b tempest-GroupSnapshotsV319Test-34955716 None] group_snapshot 05cec93a-edd3-487c-b5d7-eb41aa6064e1: deleted successfully
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-25399fdf-7ed3-43e0-9606-f87ebc8cacda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "cinder-quobyte-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-quobyte-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "cinder-quobyte-25399fdf-7ed3-43e0-9606-f87ebc8cacda" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-quobyte-25399fdf-7ed3-43e0-9606-f87ebc8cacda" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Deleting offline snapshot 25399fdf-7ed3-43e0-9606-f87ebc8cacda of volume 6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] snapshot_file for this snap is: volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b40c69-b087-4b79-bbcb-a245c03a3c65]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:17 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda
Aug 26 03:16:17 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:17 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda" returned: 0 in 0.441s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccdc5c4-13f9-4e8f-af7d-0694938e80e5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:18 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a
Aug 26 03:16:18 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "cinder-quobyte-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Lock "cinder-quobyte-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" acquired by "delete_volume" :: waited 0.042s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41021b1-2880-4c1c-bc10-9b990f477848]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:18 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" returned: 0 in 0.603s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:18 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda
Aug 26 03:16:18 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:18 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2
Aug 26 03:16:18 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Flow 'volume_create_manager' (b14e3fa0-e158-4fbf-81b3-9c4462a5d546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8e20db-fc76-45c9-9040-47f0eaa9fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8e20db-fc76-45c9-9040-47f0eaa9fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2041774251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea81219-5e5f-48f7-b770-924e8236f5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87e1a8ac7c142d3b7cad74ad85e6b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:19Z,use_quota=True,user_id='6d4c638da16b4914aa2a3bf6bc3bc3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8a7f7e-e7cd-4c4b-a5be-e5561544f76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8a7f7e-e7cd-4c4b-a5be-e5561544f76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8731bd-e628-4418-a4ac-104a541cae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8731bd-e628-4418-a4ac-104a541cae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea81219-5e5f-48f7-b770-924e8236f5bf', 'volume_name': 'volume-6ea81219-5e5f-48f7-b770-924e8236f5bf', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f7efc0-9e97-4b6c-a24c-930106d6e6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f7efc0-9e97-4b6c-a24c-930106d6e6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705438ef-0f46-4bb9-81ec-c58ca71aa39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:18 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Volume 6ea81219-5e5f-48f7-b770-924e8236f5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea81219-5e5f-48f7-b770-924e8236f5bf', 'volume_size': 1}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2041774251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea81219-5e5f-48f7-b770-924e8236f5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87e1a8ac7c142d3b7cad74ad85e6b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:19Z,use_quota=True,user_id='6d4c638da16b4914aa2a3bf6bc3bc3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Creating volume 6ea81219-5e5f-48f7-b770-924e8236f5bf {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:19 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:19 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" returned: 0 in 0.653s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:19 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf 1073741824
Aug 26 03:16:19 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:19 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2
Aug 26 03:16:19 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:19 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda" returned: 0 in 0.511s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:19 devstack sudo[107525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda
Aug 26 03:16:19 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:19 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" returned: 0 in 0.501s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Lock "cinder-quobyte-76556bd4-5eea-4b26-8e24-f7a2c3f8f6b2" released by "delete_volume" :: held 1.289s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:19 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a.25399fdf-7ed3-43e0-9606-f87ebc8cacda" returned: 0 in 0.575s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-quobyte-25399fdf-7ed3-43e0-9606-f87ebc8cacda" released by "_delete_snapshot" :: held 2.359s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-quobyte-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" released by "delete_snapshot" :: held 2.408s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Created reservations ['7d9feac6-72a2-4c02-8ba3-aa6a45d503ae'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:19 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:19 devstack cinder-volume[94326]: WARNING cinder.quota [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-948953385 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-948953385, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf 1073741824" returned: 0 in 0.900s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Created reservations ['0d87f406-99c8-499e-9c5f-98e2e230588f', '554d9465-5513-48b7-8109-f437e281e6bf', '2d3c74fb-d633-45ac-83d6-85e70917b134', '8aa9de69-82c7-4c16-b406-008de1a6235c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Created reservations ['57de7d3a-3fab-4e55-975e-abfa67c203be', '44c8b9f4-06b5-4aa0-9348-eeea8d5d3195', '8a5683ce-692b-4ea2-ab26-138b9578f266', '99161bdb-1a4a-4adb-a204-4bc879672991'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:20 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf
Aug 26 03:16:20 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Delete snapshot completed successfully.
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8354c944-3782-41e2-a2ff-40bba2f7e3ea tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-25399fdf-7ed3-43e0-9606-f87ebc8cacda-delete_snapshot" released by "delete_snapshot" :: held 2.931s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:20 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:20 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:20 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf" returned: 0 in 0.528s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705438ef-0f46-4bb9-81ec-c58ca71aa39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea81219-5e5f-48f7-b770-924e8236f5bf', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48037cb3-bd68-45a3-9237-f6e223369e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:20 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Volume volume-6ea81219-5e5f-48f7-b770-924e8236f5bf (6ea81219-5e5f-48f7-b770-924e8236f5bf): created successfully
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48037cb3-bd68-45a3-9237-f6e223369e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Flow 'volume_create_manager' (b14e3fa0-e158-4fbf-81b3-9c4462a5d546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-620b58a5-d460-4cfc-8393-59f768ac157a tempest-VolumesMetadataTest-1716461833 None] Created volume successfully.
Aug 26 03:16:20 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.497s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4f3e6f9c-9b10-481e-b145-782f425d47ff tempest-GroupSnapshotsV319Test-34955716 None] Delete group completed successfully.
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "cinder-6bef320a-2d66-4bb2-867c-ebb9e9f3727a-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-6bef320a-2d66-4bb2-867c-ebb9e9f3727a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "cinder-quobyte-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-quobyte-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ffa706-ce3a-4380-979a-0f3a29409787]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:21 devstack sudo[107609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a
Aug 26 03:16:21 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:21 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" returned: 0 in 0.454s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:21 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a
Aug 26 03:16:21 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:21 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" returned: 0 in 0.336s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-quobyte-6bef320a-2d66-4bb2-867c-ebb9e9f3727a" released by "delete_volume" :: held 0.870s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:21 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Created reservations ['5c954ea6-869b-46b2-8ab0-bf2c199c59dc', 'f0afb458-c022-413e-963b-64ae646b9aea', '3fd7116b-2c6c-4e3c-9d24-28e57f0a5021', 'bb0d8fa1-c606-4389-b271-b807928345c2'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:22 devstack sudo[107627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:22 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Acquiring lock "cinder-6ea81219-5e5f-48f7-b770-924e8236f5bf-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Lock "cinder-6ea81219-5e5f-48f7-b770-924e8236f5bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Acquiring lock "cinder-quobyte-6ea81219-5e5f-48f7-b770-924e8236f5bf" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Lock "cinder-quobyte-6ea81219-5e5f-48f7-b770-924e8236f5bf" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[02af5098-ab6d-4c4c-a493-9cff5c5d0608]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:22 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.546s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:22 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Deleted volume successfully.
Aug 26 03:16:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a70a7251-b9a1-469b-9c7a-e7b0ac6af818 tempest-SnapshotMetadataTestJSON-825878122 None] Lock "cinder-6bef320a-2d66-4bb2-867c-ebb9e9f3727a-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:22 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf
Aug 26 03:16:22 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:23 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf" returned: 0 in 0.621s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:23 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf
Aug 26 03:16:23 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:23 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6ea81219-5e5f-48f7-b770-924e8236f5bf" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Lock "cinder-quobyte-6ea81219-5e5f-48f7-b770-924e8236f5bf" released by "delete_volume" :: held 1.112s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Created reservations ['8fa93be3-e76d-440a-81d4-9b42eea39bd1', 'dfa3f729-11ee-4a62-9092-429800db9dff', '324f85d2-1ba8-4e5f-ac54-cf25e4fab691', '2d493531-48d5-498b-9c35-ecf1e3c52f8e'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:23 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:23 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:24 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.424s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:24 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Deleted volume successfully.
Aug 26 03:16:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d25cbe96-1352-4a6d-9e21-adb76442a870 tempest-VolumesMetadataTest-1716461833 None] Lock "cinder-6ea81219-5e5f-48f7-b770-924e8236f5bf-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Flow 'volume_create_manager' (0d8b4937-8f0d-48e0-9102-ec782d21124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc3a5b9-825e-4272-b421-f07f3b5ec562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc3a5b9-825e-4272-b421-f07f3b5ec562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1656265555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0632974e-5654-488d-b78e-74f5f5b7d896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaa874bc54a4b1a999b5693cb9209d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:30Z,use_quota=True,user_id='0f56e3f8686e40049f99ed3f610d983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6892eb-826e-43d6-9127-fbca90b1a174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6892eb-826e-43d6-9127-fbca90b1a174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2980e6bb-384f-4edb-ad17-e55baf17b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2980e6bb-384f-4edb-ad17-e55baf17b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0632974e-5654-488d-b78e-74f5f5b7d896', 'volume_name': 'volume-0632974e-5654-488d-b78e-74f5f5b7d896', 'volume_size': 2}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ca624a-4344-4f04-b452-db7509ebe9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ca624a-4344-4f04-b452-db7509ebe9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9347a181-021b-4e88-b1c4-a56a632c462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:30 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Volume 0632974e-5654-488d-b78e-74f5f5b7d896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0632974e-5654-488d-b78e-74f5f5b7d896', 'volume_size': 2}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1656265555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0632974e-5654-488d-b78e-74f5f5b7d896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaa874bc54a4b1a999b5693cb9209d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:30Z,use_quota=True,user_id='0f56e3f8686e40049f99ed3f610d983c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Creating volume 0632974e-5654-488d-b78e-74f5f5b7d896 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:30 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896 2147483648 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:30 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896 2147483648
Aug 26 03:16:30 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:30 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896 2147483648" returned: 0 in 0.615s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:30 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896
Aug 26 03:16:30 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:31 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896" returned: 0 in 0.380s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9347a181-021b-4e88-b1c4-a56a632c462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0632974e-5654-488d-b78e-74f5f5b7d896', 'volume_size': 2}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a2092d-c92b-409a-bb2e-be016b6f1aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Volume volume-0632974e-5654-488d-b78e-74f5f5b7d896 (0632974e-5654-488d-b78e-74f5f5b7d896): created successfully
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a2092d-c92b-409a-bb2e-be016b6f1aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Flow 'volume_create_manager' (0d8b4937-8f0d-48e0-9102-ec782d21124c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:31 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-edc35d99-cfef-4a29-aa50-2a112cee69fe tempest-VolumesCloneNegativeTest-1637228811 None] Created volume successfully.
Aug 26 03:16:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Acquiring lock "cinder-0632974e-5654-488d-b78e-74f5f5b7d896-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Lock "cinder-0632974e-5654-488d-b78e-74f5f5b7d896-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Acquiring lock "cinder-quobyte-0632974e-5654-488d-b78e-74f5f5b7d896" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Lock "cinder-quobyte-0632974e-5654-488d-b78e-74f5f5b7d896" acquired by "delete_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:32 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a6a62-cffc-4150-86c1-3b0c2c0e7f68]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:32 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896
Aug 26 03:16:32 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:33 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896" returned: 0 in 0.632s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:33 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896
Aug 26 03:16:33 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:34 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0632974e-5654-488d-b78e-74f5f5b7d896" returned: 0 in 0.579s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Lock "cinder-quobyte-0632974e-5654-488d-b78e-74f5f5b7d896" released by "delete_volume" :: held 1.280s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Created reservations ['2d01df45-15eb-47de-b301-bfa03d663a80', 'a71bb58d-0899-48b1-a5fa-05c19eef8126', '33bf7e09-775d-47de-a189-1cc64ca42430', '92d3123c-ae32-4c29-9162-ad4341e4928c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:34 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:34 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:34 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.335s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Deleted volume successfully.
Aug 26 03:16:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fc0531db-a03e-4365-93a2-7f7ef84aa34b tempest-VolumesCloneNegativeTest-1637228811 None] Lock "cinder-0632974e-5654-488d-b78e-74f5f5b7d896-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Flow 'volume_create_manager' (68481702-3ad0-4912-8691-42b263cdd5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb26675-21b4-476e-afaa-beb160fa008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb26675-21b4-476e-afaa-beb160fa008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1971915572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d1224d-abfc-4fa3-bf49-5adb881c378d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad33164aeee46da8f44bbb7feedacae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:39Z,use_quota=True,user_id='701a3b84ad5b4d2ea1d1f483f91eaa83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc103f0d-318f-4ffa-a6c0-b5c4945a10d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc103f0d-318f-4ffa-a6c0-b5c4945a10d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609f4d97-e490-4eb0-a87f-77ae9a72378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609f4d97-e490-4eb0-a87f-77ae9a72378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d1224d-abfc-4fa3-bf49-5adb881c378d', 'volume_name': 'volume-10d1224d-abfc-4fa3-bf49-5adb881c378d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb969f24-18a6-42ad-910f-c330a25e4c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb969f24-18a6-42ad-910f-c330a25e4c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c9028a-02d3-4555-9dd7-22e73f682ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:39 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Volume 10d1224d-abfc-4fa3-bf49-5adb881c378d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d1224d-abfc-4fa3-bf49-5adb881c378d', 'volume_size': 1}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1971915572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d1224d-abfc-4fa3-bf49-5adb881c378d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad33164aeee46da8f44bbb7feedacae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:39Z,use_quota=True,user_id='701a3b84ad5b4d2ea1d1f483f91eaa83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Creating volume 10d1224d-abfc-4fa3-bf49-5adb881c378d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:39 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:39 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d 1073741824
Aug 26 03:16:39 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:40 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d 1073741824" returned: 0 in 0.516s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:40 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d
Aug 26 03:16:40 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:40 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c9028a-02d3-4555-9dd7-22e73f682ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d1224d-abfc-4fa3-bf49-5adb881c378d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6db82f-0d7a-43e0-b30c-43826fbb4711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:40 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Volume volume-10d1224d-abfc-4fa3-bf49-5adb881c378d (10d1224d-abfc-4fa3-bf49-5adb881c378d): created successfully
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6db82f-0d7a-43e0-b30c-43826fbb4711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Flow 'volume_create_manager' (68481702-3ad0-4912-8691-42b263cdd5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:40 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=125,cinder:UPDATE=149,cinder:INSERT=37,cinder:DELETE=9 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:16:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-490a6ddd-50e5-419b-aabc-f80d83889fd3 tempest-VolumesNegativeTest-174933718 None] Created volume successfully.
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Flow 'volume_create_manager' (60e79be2-9302-4783-bc20-9420f0350692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0daa727-6104-40b5-a6b4-8ed39769aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0daa727-6104-40b5-a6b4-8ed39769aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156945627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e330343-7c16-4146-b9d0-2f4a1bda2853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751a9b25bff4a0e90c00bb4e68598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:47Z,use_quota=True,user_id='d88776ec324d4dbdb3ad6ff2e3c2314d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e224131-bf8a-4b38-a7a1-993b38b5fe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e224131-bf8a-4b38-a7a1-993b38b5fe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528cc493-7cc6-4a93-b4e6-0831abafb132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528cc493-7cc6-4a93-b4e6-0831abafb132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e330343-7c16-4146-b9d0-2f4a1bda2853', 'volume_name': 'volume-7e330343-7c16-4146-b9d0-2f4a1bda2853', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d79f5-ec4d-4c10-99ea-397f9ccacf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d79f5-ec4d-4c10-99ea-397f9ccacf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf99b916-ea44-4cf4-9859-7fa08218932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Volume 7e330343-7c16-4146-b9d0-2f4a1bda2853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e330343-7c16-4146-b9d0-2f4a1bda2853', 'volume_size': 1}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156945627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e330343-7c16-4146-b9d0-2f4a1bda2853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8751a9b25bff4a0e90c00bb4e68598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:47Z,use_quota=True,user_id='d88776ec324d4dbdb3ad6ff2e3c2314d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Creating volume 7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:46 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:47 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 1073741824
Aug 26 03:16:47 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:47 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 1073741824" returned: 0 in 0.904s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:47 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:16:47 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Flow 'volume_create_manager' (b2af8bca-6591-40e1-bf3c-c934eb4d4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327bf88a-65b8-45b0-82ae-f20cdc889767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327bf88a-65b8-45b0-82ae-f20cdc889767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2114435201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4981954-d9eb-400f-aa6d-912c790d1177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e84672527e4dc5b65ff68eb10dcf60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:48Z,use_quota=True,user_id='65ca946d7ebc4083ae0eed5c230f1b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35b5fde-62f8-4bff-91ab-483885e0692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35b5fde-62f8-4bff-91ab-483885e0692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db7d79f-6aed-4633-9936-92069ca944d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db7d79f-6aed-4633-9936-92069ca944d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4981954-d9eb-400f-aa6d-912c790d1177', 'volume_name': 'volume-e4981954-d9eb-400f-aa6d-912c790d1177', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63574dc-84cd-4e81-b432-d41cd026cae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63574dc-84cd-4e81-b432-d41cd026cae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db190bd-e0c2-432d-a829-32bd44b7b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:48 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Volume e4981954-d9eb-400f-aa6d-912c790d1177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4981954-d9eb-400f-aa6d-912c790d1177', 'volume_size': 1}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:48 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2114435201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4981954-d9eb-400f-aa6d-912c790d1177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e84672527e4dc5b65ff68eb10dcf60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:48Z,use_quota=True,user_id='65ca946d7ebc4083ae0eed5c230f1b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Creating volume e4981954-d9eb-400f-aa6d-912c790d1177 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:48 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf99b916-ea44-4cf4-9859-7fa08218932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e330343-7c16-4146-b9d0-2f4a1bda2853', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc60e16-f0ae-4bc7-adf9-a12a635cfdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:48 devstack sudo[107766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177 1073741824
Aug 26 03:16:48 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:48 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Volume volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 (7e330343-7c16-4146-b9d0-2f4a1bda2853): created successfully
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc60e16-f0ae-4bc7-adf9-a12a635cfdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Flow 'volume_create_manager' (60e79be2-9302-4783-bc20-9420f0350692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bc32ac7f-d96d-4cfc-8116-3e559052ae4e tempest-VolumesActionsTest-1832454505 None] Created volume successfully.
Aug 26 03:16:48 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177 1073741824" returned: 0 in 0.602s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:49 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177
Aug 26 03:16:49 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:49 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177" returned: 0 in 0.593s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db190bd-e0c2-432d-a829-32bd44b7b287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4981954-d9eb-400f-aa6d-912c790d1177', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8635a512-8bf7-4e9a-8952-c590c437cbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:49 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Volume volume-e4981954-d9eb-400f-aa6d-912c790d1177 (e4981954-d9eb-400f-aa6d-912c790d1177): created successfully
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8635a512-8bf7-4e9a-8952-c590c437cbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Flow 'volume_create_manager' (b2af8bca-6591-40e1-bf3c-c934eb4d4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a04f5d5c-3679-440d-8839-d7201aca7154 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Created volume successfully.
Aug 26 03:16:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-6b285814-1964-49f4-96c8-0a85f3a1a58c req-542dbc57-78c0-4e26-a0b5-4a0b3f735a9e tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-6b285814-1964-49f4-96c8-0a85f3a1a58c req-542dbc57-78c0-4e26-a0b5-4a0b3f735a9e tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-6b285814-1964-49f4-96c8-0a85f3a1a58c req-542dbc57-78c0-4e26-a0b5-4a0b3f735a9e tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-6b285814-1964-49f4-96c8-0a85f3a1a58c req-542dbc57-78c0-4e26-a0b5-4a0b3f735a9e tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-e4981954-d9eb-400f-aa6d-912c790d1177', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b0b46f7-4c3d-475a-a9a9-a67a773d6e43', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:16:51 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-6b285814-1964-49f4-96c8-0a85f3a1a58c req-542dbc57-78c0-4e26-a0b5-4a0b3f735a9e tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] attachment_update completed successfully.
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Flow 'volume_create_manager' (f5471a36-5284-46e3-a831-7dc1abe929b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4240fc8-d3b7-43f7-b5ad-8f512ccce2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4240fc8-d3b7-43f7-b5ad-8f512ccce2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1931205102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1af83f-9b99-490f-b3b1-3448558ddabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6089006d96164de4b6cea72991eb14ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:54Z,use_quota=True,user_id='13a0cae9e25b4072b4fec91f8dd06e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051997b4-3928-45ce-aad5-509917bd8000),volume_type_id=051997b4-3928-45ce-aad5-509917bd8000)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad1ef47-af3e-4901-8a45-e7cd38855bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad1ef47-af3e-4901-8a45-e7cd38855bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd4d7c5-81cf-4bdb-9ed0-f2faed215072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd4d7c5-81cf-4bdb-9ed0-f2faed215072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1af83f-9b99-490f-b3b1-3448558ddabb', 'volume_name': 'volume-4a1af83f-9b99-490f-b3b1-3448558ddabb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d87adb7-85aa-400d-bb57-e5ba6b7a90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d87adb7-85aa-400d-bb57-e5ba6b7a90a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0c9277-7aec-4bc9-aa5c-aabe602f9f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:54 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Volume 4a1af83f-9b99-490f-b3b1-3448558ddabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1af83f-9b99-490f-b3b1-3448558ddabb', 'volume_size': 1}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1931205102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1af83f-9b99-490f-b3b1-3448558ddabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6089006d96164de4b6cea72991eb14ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:54Z,use_quota=True,user_id='13a0cae9e25b4072b4fec91f8dd06e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051997b4-3928-45ce-aad5-509917bd8000),volume_type_id=051997b4-3928-45ce-aad5-509917bd8000)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Creating volume 4a1af83f-9b99-490f-b3b1-3448558ddabb {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:16:54 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:16:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:54 devstack sudo[108273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb 1073741824
Aug 26 03:16:54 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:55 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb 1073741824" returned: 0 in 0.904s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:55 devstack sudo[108279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb
Aug 26 03:16:55 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:55 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0c9277-7aec-4bc9-aa5c-aabe602f9f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1af83f-9b99-490f-b3b1-3448558ddabb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585a288c-c816-4b9b-a97f-0a33babef99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:16:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Volume volume-4a1af83f-9b99-490f-b3b1-3448558ddabb (4a1af83f-9b99-490f-b3b1-3448558ddabb): created successfully
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585a288c-c816-4b9b-a97f-0a33babef99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:16:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Flow 'volume_create_manager' (f5471a36-5284-46e3-a831-7dc1abe929b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:16:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bd2c53b2-2b87-406c-bc33-2abffb59fc5d tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Created volume successfully.
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:57 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:16:57 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:57 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.414s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:57 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:16:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2fd990e7-0b7e-48f7-918c-8cd6350c84d6 tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Retype volume completed successfully.
Aug 26 03:16:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-10f4bd5b-e6dc-418d-b243-47e690d60c13 req-afe36a02-4e7a-42d2-9891-a20060380cd5 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Terminate volume connection completed successfully.
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-10f4bd5b-e6dc-418d-b243-47e690d60c13 req-afe36a02-4e7a-42d2-9891-a20060380cd5 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Deleting attachment 8b0b46f7-4c3d-475a-a9a9-a67a773d6e43. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Acquiring lock "cinder-4a1af83f-9b99-490f-b3b1-3448558ddabb-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "cinder-4a1af83f-9b99-490f-b3b1-3448558ddabb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Acquiring lock "cinder-quobyte-4a1af83f-9b99-490f-b3b1-3448558ddabb" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "cinder-quobyte-4a1af83f-9b99-490f-b3b1-3448558ddabb" acquired by "delete_volume" :: waited 0.064s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25bba83-d225-4b69-b11f-a896f2498e84]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:59 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb
Aug 26 03:16:59 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Acquiring lock "cinder-e4981954-d9eb-400f-aa6d-912c790d1177-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "cinder-e4981954-d9eb-400f-aa6d-912c790d1177-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Acquiring lock "cinder-quobyte-e4981954-d9eb-400f-aa6d-912c790d1177" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "cinder-quobyte-e4981954-d9eb-400f-aa6d-912c790d1177" acquired by "delete_volume" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4110ec5d-e129-41ca-99f0-4aec82e4d48b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:59 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb" returned: 0 in 0.754s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:16:59 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb
Aug 26 03:16:59 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:59 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177
Aug 26 03:16:59 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:16:59 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4a1af83f-9b99-490f-b3b1-3448558ddabb" returned: 0 in 0.412s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:16:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "cinder-quobyte-4a1af83f-9b99-490f-b3b1-3448558ddabb" released by "delete_volume" :: held 1.319s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:00 devstack cinder-volume[94326]: WARNING cinder.quota [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:17:00 devstack cinder-volume[94326]: WARNING cinder.quota [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Created reservations ['a044f7f9-f4c8-4880-8611-79c9b9b74f7b', '17c7a88f-15db-4448-8b0a-e15af329c433', '23878706-ab71-4996-ad43-6bc225bb57de', '0a86c194-5733-4484-9132-9938e9fcc5e5'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:00 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177" returned: 0 in 0.774s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:00 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:00 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:00 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:00 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:00 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e4981954-d9eb-400f-aa6d-912c790d1177" returned: 0 in 0.374s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "cinder-quobyte-e4981954-d9eb-400f-aa6d-912c790d1177" released by "delete_volume" :: held 1.210s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:00 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.348s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Deleted volume successfully.
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Created reservations ['49deb6f6-6e9e-4fdc-8331-a82ad5c82a5c', '2f4f5eff-c281-47d7-b869-433e2f070949', '7c8deee4-6676-458b-be0b-70fabd5d27e0', '1f08f150-eb67-4cde-a5c2-52986a83693c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-67927e84-eb3e-4890-b7d0-dfc74e6f7efc tempest-VolumeRetypeWithoutMigrationTest-810576826 None] Lock "cinder-4a1af83f-9b99-490f-b3b1-3448558ddabb-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:00 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:00 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:01 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:01 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Deleted volume successfully.
Aug 26 03:17:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-99cd7d9a-b232-4b30-952b-b00832589028 tempest-TestServerVolumeAttachScenarioOldVersion-820221083 None] Lock "cinder-e4981954-d9eb-400f-aa6d-912c790d1177-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4a407757-4d2b-4215-aa82-ff3247318bea tempest-VolumesActionsTest-1832454505 None] Acquiring lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853" by "attach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4a407757-4d2b-4215-aa82-ff3247318bea tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853" acquired by "attach_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4a407757-4d2b-4215-aa82-ff3247318bea tempest-VolumesActionsTest-1832454505 None] Attaching volume 7e330343-7c16-4146-b9d0-2f4a1bda2853 to instance 7fd19bc8-0cfa-40ce-827b-c37d69e956cd at mountpoint /dev/vdb on host None.
Aug 26 03:17:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4a407757-4d2b-4215-aa82-ff3247318bea tempest-VolumesActionsTest-1832454505 None] Attach volume completed successfully.
Aug 26 03:17:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4a407757-4d2b-4215-aa82-ff3247318bea tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853" released by "attach_volume" :: held 0.171s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-28e8c32f-fb11-49c0-a2b3-8672ab51f6f9 tempest-VolumesActionsTest-1832454505 None] Acquiring lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-detach_volume" by "detach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-28e8c32f-fb11-49c0-a2b3-8672ab51f6f9 tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-28e8c32f-fb11-49c0-a2b3-8672ab51f6f9 tempest-VolumesActionsTest-1832454505 None] Detaching volume 7e330343-7c16-4146-b9d0-2f4a1bda2853 from instance 7fd19bc8-0cfa-40ce-827b-c37d69e956cd.
Aug 26 03:17:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-28e8c32f-fb11-49c0-a2b3-8672ab51f6f9 tempest-VolumesActionsTest-1832454505 None] Detach volume completed successfully.
Aug 26 03:17:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-28e8c32f-fb11-49c0-a2b3-8672ab51f6f9 tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Flow 'volume_create_manager' (64463492-3ef3-45a4-82ea-4cc1eb02ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bb1979-163e-4d8d-a234-1dc15bb2ff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bb1979-163e-4d8d-a234-1dc15bb2ff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1169477914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0766c713-0941-4153-9fbc-3656d384775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb0f102b26400bb22459f5923c6d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:11Z,use_quota=True,user_id='06f10f38a96b4588ba71a449b2b20b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cac9df-62d3-4381-8191-10618ea41297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cac9df-62d3-4381-8191-10618ea41297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9925ff8-99be-41b4-9335-95ef559a2dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9925ff8-99be-41b4-9335-95ef559a2dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0766c713-0941-4153-9fbc-3656d384775d', 'volume_name': 'volume-0766c713-0941-4153-9fbc-3656d384775d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814e3e89-a247-4db7-91df-86200cdfd935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814e3e89-a247-4db7-91df-86200cdfd935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf78e18-0865-46a9-a724-835dea379e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Volume 0766c713-0941-4153-9fbc-3656d384775d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0766c713-0941-4153-9fbc-3656d384775d', 'volume_size': 1}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1169477914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0766c713-0941-4153-9fbc-3656d384775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb0f102b26400bb22459f5923c6d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:11Z,use_quota=True,user_id='06f10f38a96b4588ba71a449b2b20b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Creating volume 0766c713-0941-4153-9fbc-3656d384775d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:17:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:17:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:10 devstack sudo[108512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d 1073741824
Aug 26 03:17:10 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Acquiring lock "cinder-10d1224d-abfc-4fa3-bf49-5adb881c378d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Lock "cinder-10d1224d-abfc-4fa3-bf49-5adb881c378d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Acquiring lock "cinder-quobyte-10d1224d-abfc-4fa3-bf49-5adb881c378d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Lock "cinder-quobyte-10d1224d-abfc-4fa3-bf49-5adb881c378d" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f1b3f-d0aa-4916-9b80-3bd7d2007abe]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:11 devstack sudo[108517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d
Aug 26 03:17:11 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:11 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d 1073741824" returned: 0 in 0.649s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:11 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d
Aug 26 03:17:11 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:11 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d" returned: 0 in 0.540s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:11 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d
Aug 26 03:17:11 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:11 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf78e18-0865-46a9-a724-835dea379e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0766c713-0941-4153-9fbc-3656d384775d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25c791e-4175-4bdd-b2c7-cd5b407b771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Volume volume-0766c713-0941-4153-9fbc-3656d384775d (0766c713-0941-4153-9fbc-3656d384775d): created successfully
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25c791e-4175-4bdd-b2c7-cd5b407b771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Flow 'volume_create_manager' (64463492-3ef3-45a4-82ea-4cc1eb02ed25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ae74071f-6b5c-4404-a614-70f0ee11fddd tempest-VolumesListAdminTestJSON-1290057043 None] Created volume successfully.
Aug 26 03:17:12 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-10d1224d-abfc-4fa3-bf49-5adb881c378d" returned: 0 in 0.291s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Lock "cinder-quobyte-10d1224d-abfc-4fa3-bf49-5adb881c378d" released by "delete_volume" :: held 0.898s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Created reservations ['9c2b4af2-7eb8-49c3-a50e-52c4bbea6d47', 'de44b9dc-f365-42dc-b8ca-bf638863b00f', '15f15929-2f04-4844-9dd0-d4bb47a5fade', '5e5290d0-496f-489f-907d-396e0b28d59a'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:12 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:12 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:12 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.383s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Deleted volume successfully.
Aug 26 03:17:12 devstack sudo[108538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:12 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2f528ad8-b6f9-40e2-9a02-79ee4337777f tempest-VolumesNegativeTest-174933718 None] Lock "cinder-10d1224d-abfc-4fa3-bf49-5adb881c378d-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:12 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.375s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:17:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Flow 'volume_create_manager' (9c75dd76-5ca6-4115-bad6-ea00fd39bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb687b5-f7fb-4cb1-8422-5692c5b79673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb687b5-f7fb-4cb1-8422-5692c5b79673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1973266479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbed92e-7919-48f5-bdca-2cb5d8266b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb0f102b26400bb22459f5923c6d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:14Z,use_quota=True,user_id='06f10f38a96b4588ba71a449b2b20b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d298f7d5-b0a0-490c-8ab1-f008aa3519f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d298f7d5-b0a0-490c-8ab1-f008aa3519f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec8c00a-ba79-44a4-a77b-aefdb7de9f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec8c00a-ba79-44a4-a77b-aefdb7de9f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbed92e-7919-48f5-bdca-2cb5d8266b7c', 'volume_name': 'volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669c80c6-8463-4458-a046-0fb69fecdbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669c80c6-8463-4458-a046-0fb69fecdbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8754bd-e3e0-447d-b026-cd421af3ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Volume 4bbed92e-7919-48f5-bdca-2cb5d8266b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c', 'volume_size': 1}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1973266479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbed92e-7919-48f5-bdca-2cb5d8266b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb0f102b26400bb22459f5923c6d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:14Z,use_quota=True,user_id='06f10f38a96b4588ba71a449b2b20b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Creating volume 4bbed92e-7919-48f5-bdca-2cb5d8266b7c {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:17:14 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:17:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:14 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c 1073741824
Aug 26 03:17:14 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:14 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c 1073741824" returned: 0 in 0.825s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:14 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c
Aug 26 03:17:14 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:15 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c" returned: 0 in 0.416s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8754bd-e3e0-447d-b026-cd421af3ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8817c8e9-0c7e-469b-9d07-b978b155b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:15 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Volume volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c (4bbed92e-7919-48f5-bdca-2cb5d8266b7c): created successfully
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8817c8e9-0c7e-469b-9d07-b978b155b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Flow 'volume_create_manager' (9c75dd76-5ca6-4115-bad6-ea00fd39bde5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9a1507ce-b11e-4a3c-ba6f-f7b8620d37c9 tempest-VolumesListAdminTestJSON-1290057043 None] Created volume successfully.
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Flow 'volume_create_manager' (32b0b1c8-d0b9-4eea-b5e2-7190075c8534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bcbe64-8378-4b77-bce3-52ecaa922ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bcbe64-8378-4b77-bce3-52ecaa922ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1196210003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6822415-58f4-4828-abe9-3d22fae85d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb0f102b26400bb22459f5923c6d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:16Z,use_quota=True,user_id='06f10f38a96b4588ba71a449b2b20b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905dea22-9bbf-4344-b43b-50c88d1e7771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905dea22-9bbf-4344-b43b-50c88d1e7771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fb1b19-6744-4395-8794-28a33aa381fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fb1b19-6744-4395-8794-28a33aa381fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6822415-58f4-4828-abe9-3d22fae85d84', 'volume_name': 'volume-c6822415-58f4-4828-abe9-3d22fae85d84', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5613c2d-cf8a-4455-8ec8-3e0a75d68069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5613c2d-cf8a-4455-8ec8-3e0a75d68069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c483c3b-2cdf-4917-b4b6-c9feaf86623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Volume c6822415-58f4-4828-abe9-3d22fae85d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6822415-58f4-4828-abe9-3d22fae85d84', 'volume_size': 1}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1196210003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6822415-58f4-4828-abe9-3d22fae85d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69eb0f102b26400bb22459f5923c6d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:16Z,use_quota=True,user_id='06f10f38a96b4588ba71a449b2b20b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Creating volume c6822415-58f4-4828-abe9-3d22fae85d84 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:17:16 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:16 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84 1073741824
Aug 26 03:17:16 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Flow 'volume_create_manager' (a40402fd-8191-4ff4-851e-5fb7a580b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e80ec81-d034-4981-ad9f-46d0effd1552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e80ec81-d034-4981-ad9f-46d0effd1552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1356079117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d244888-a60e-4b92-abd3-06f4a16d2723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710a56ef3f1d4efe87e908783d76f883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:17Z,use_quota=True,user_id='b334f88c695447d5a2ac64746a4ead8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaa8916-50eb-4445-a541-8668465b8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaa8916-50eb-4445-a541-8668465b8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458c08ca-8d08-4254-9422-d5998c5f8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458c08ca-8d08-4254-9422-d5998c5f8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d244888-a60e-4b92-abd3-06f4a16d2723', 'volume_name': 'volume-3d244888-a60e-4b92-abd3-06f4a16d2723', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd30b5ab-a1ea-433d-b0ef-b8dee9c3cd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd30b5ab-a1ea-433d-b0ef-b8dee9c3cd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cba925-06c5-45c8-bd47-5d65ab4c813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Volume 3d244888-a60e-4b92-abd3-06f4a16d2723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d244888-a60e-4b92-abd3-06f4a16d2723', 'volume_size': 1}
Aug 26 03:17:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:17 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84 1073741824" returned: 0 in 0.598s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=87,cinder:INSERT=22,cinder:UPDATE=105,cinder:DELETE=11 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:17 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84
Aug 26 03:17:17 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:17 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84" returned: 0 in 0.310s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1356079117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d244888-a60e-4b92-abd3-06f4a16d2723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710a56ef3f1d4efe87e908783d76f883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:17Z,use_quota=True,user_id='b334f88c695447d5a2ac64746a4ead8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Creating volume 3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:17:17 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:17 devstack sudo[108593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 1073741824
Aug 26 03:17:17 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c483c3b-2cdf-4917-b4b6-c9feaf86623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6822415-58f4-4828-abe9-3d22fae85d84', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4875c4-2861-4fb3-8472-99a74a47a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:17 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Volume volume-c6822415-58f4-4828-abe9-3d22fae85d84 (c6822415-58f4-4828-abe9-3d22fae85d84): created successfully
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4875c4-2861-4fb3-8472-99a74a47a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Flow 'volume_create_manager' (32b0b1c8-d0b9-4eea-b5e2-7190075c8534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-696f3bce-0bb3-4922-95eb-19bcd88214c4 tempest-VolumesListAdminTestJSON-1290057043 None] Created volume successfully.
Aug 26 03:17:18 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 1073741824" returned: 0 in 0.825s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:18 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723
Aug 26 03:17:18 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:18 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723" returned: 0 in 0.305s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cba925-06c5-45c8-bd47-5d65ab4c813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d244888-a60e-4b92-abd3-06f4a16d2723', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78b2d91-af0f-4012-8651-3b0a292436df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:18 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Volume volume-3d244888-a60e-4b92-abd3-06f4a16d2723 (3d244888-a60e-4b92-abd3-06f4a16d2723): created successfully
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78b2d91-af0f-4012-8651-3b0a292436df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:18 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Flow 'volume_create_manager' (a40402fd-8191-4ff4-851e-5fb7a580b073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:19 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ca72268e-90e3-4f85-9344-c9304b5ab012 tempest-VolumeDependencyTests-783388463 None] Created volume successfully.
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Flow 'volume_create_manager' (75ecece9-cff9-46e8-b91e-fc69d0f99eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1948c9-a34f-4d76-b10c-fbc235f5727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1948c9-a34f-4d76-b10c-fbc235f5727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c16240-5460-41d2-8c6d-384aa4226356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff482c0c8aa4be9ab13dfdbd3b6ace9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:20Z,use_quota=True,user_id='4b9ebdec62934c59be5f2530f0d64b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7622c6a-8067-427d-a514-2835dc5e2252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7622c6a-8067-427d-a514-2835dc5e2252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077ee007-8d82-48da-9b8f-737965e767d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077ee007-8d82-48da-9b8f-737965e767d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c16240-5460-41d2-8c6d-384aa4226356', 'volume_name': 'volume-42c16240-5460-41d2-8c6d-384aa4226356', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a069d2f8-ecbd-4929-bb11-34e585a8adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a069d2f8-ecbd-4929-bb11-34e585a8adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f5d522-857a-4b57-b367-46e806ba6288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:19 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Volume 42c16240-5460-41d2-8c6d-384aa4226356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c16240-5460-41d2-8c6d-384aa4226356', 'volume_size': 1}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c16240-5460-41d2-8c6d-384aa4226356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff482c0c8aa4be9ab13dfdbd3b6ace9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:20Z,use_quota=True,user_id='4b9ebdec62934c59be5f2530f0d64b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Creating volume 42c16240-5460-41d2-8c6d-384aa4226356 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:17:19 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:17:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:19 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356 1073741824
Aug 26 03:17:19 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:20 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356 1073741824" returned: 0 in 0.579s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:20 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356
Aug 26 03:17:20 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:20 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356" returned: 0 in 0.407s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.199s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f5d522-857a-4b57-b367-46e806ba6288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c16240-5460-41d2-8c6d-384aa4226356', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31bb45d-9e9f-4aa7-b192-61521918fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Creating offline snapshot 3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 of volume 3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:17:20 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Volume volume-42c16240-5460-41d2-8c6d-384aa4226356 (42c16240-5460-41d2-8c6d-384aa4226356): created successfully
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31bb45d-9e9f-4aa7-b192-61521918fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Flow 'volume_create_manager' (75ecece9-cff9-46e8-b91e-fc69d0f99eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd051b6-44c1-4385-9d6f-669af28cfa77]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6ae1a96c-edf3-44e0-80ac-636d44eaaf0f tempest-VolumesListAdminTestJSON-1732288975 None] Created volume successfully.
Aug 26 03:17:21 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723
Aug 26 03:17:21 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-922969d5-e3c5-47be-befe-3a87e19c436d tempest-VolumesActionsTest-1832454505 None] Acquiring lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853" by "attach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-922969d5-e3c5-47be-befe-3a87e19c436d tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853" acquired by "attach_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:21 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723" returned: 0 in 0.488s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:21 devstack sudo[108687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 1G
Aug 26 03:17:21 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-922969d5-e3c5-47be-befe-3a87e19c436d tempest-VolumesActionsTest-1832454505 None] Attaching volume 7e330343-7c16-4146-b9d0-2f4a1bda2853 to instance 699c035f-1831-4610-a4e8-1f53e4783aeb at mountpoint /dev/vdb on host None.
Aug 26 03:17:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-922969d5-e3c5-47be-befe-3a87e19c436d tempest-VolumesActionsTest-1832454505 None] Attach volume completed successfully.
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-922969d5-e3c5-47be-befe-3a87e19c436d tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853" released by "attach_volume" :: held 0.149s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c8f69b96-1df0-4492-9695-26a47961aa59 tempest-VolumesActionsTest-1832454505 None] Acquiring lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-detach_volume" by "detach_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c8f69b96-1df0-4492-9695-26a47961aa59 tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c8f69b96-1df0-4492-9695-26a47961aa59 tempest-VolumesActionsTest-1832454505 None] Detaching volume 7e330343-7c16-4146-b9d0-2f4a1bda2853 from instance 699c035f-1831-4610-a4e8-1f53e4783aeb.
Aug 26 03:17:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c8f69b96-1df0-4492-9695-26a47961aa59 tempest-VolumesActionsTest-1832454505 None] Detach volume completed successfully.
Aug 26 03:17:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c8f69b96-1df0-4492-9695-26a47961aa59 tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-detach_volume" released by "detach_volume" :: held 0.136s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Acquiring lock "cinder-42c16240-5460-41d2-8c6d-384aa4226356-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:22 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 1G" returned: 0 in 0.731s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d244888-a60e-4b92-abd3-06f4a16d2723 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Lock "cinder-42c16240-5460-41d2-8c6d-384aa4226356-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:22 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d244888-a60e-4b92-abd3-06f4a16d2723 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6
Aug 26 03:17:22 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Acquiring lock "cinder-quobyte-42c16240-5460-41d2-8c6d-384aa4226356" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Lock "cinder-quobyte-42c16240-5460-41d2-8c6d-384aa4226356" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8cff2-e7dd-45d4-b27a-d27f62d01748]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "cinder-c6822415-58f4-4828-abe9-3d22fae85d84-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-c6822415-58f4-4828-abe9-3d22fae85d84-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "cinder-quobyte-c6822415-58f4-4828-abe9-3d22fae85d84" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-quobyte-c6822415-58f4-4828-abe9-3d22fae85d84" acquired by "delete_volume" :: waited 0.055s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e0fb7-ed36-454d-9af1-be4b90467f10]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:22 devstack sudo[108694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356
Aug 26 03:17:22 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:22 devstack sudo[108695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84
Aug 26 03:17:22 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:22 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d244888-a60e-4b92-abd3-06f4a16d2723 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" returned: 0 in 0.826s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:22 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 is being set with open permissions: ugo+rw
Aug 26 03:17:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:22 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6
Aug 26 03:17:22 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:23 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356" returned: 0 in 0.867s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:23 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" returned: 0 in 0.386s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:23 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356
Aug 26 03:17:23 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:23 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84" returned: 0 in 0.805s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:23 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info
Aug 26 03:17:23 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:23 devstack sudo[108727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84
Aug 26 03:17:23 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:23 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c16240-5460-41d2-8c6d-384aa4226356" returned: 0 in 0.548s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Lock "cinder-quobyte-42c16240-5460-41d2-8c6d-384aa4226356" released by "delete_volume" :: held 1.486s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:23 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info" returned: 0 in 0.533s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:23 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info is being set with open permissions: ugo+rw
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:23 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c6822415-58f4-4828-abe9-3d22fae85d84" returned: 0 in 0.482s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:23 devstack sudo[108744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info
Aug 26 03:17:23 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-quobyte-c6822415-58f4-4828-abe9-3d22fae85d84" released by "delete_volume" :: held 1.346s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Created reservations ['71af46f8-ec6c-4db9-9dba-25206920febe', '89df191b-f4f4-4ee6-a76d-bfb31da63459', 'c0f96e4c-e0a2-4a74-9f9c-3718fad9125e', '9dded507-4f4f-4139-84bf-a02fd1df511b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Created reservations ['3a479211-1964-494a-8f9f-1c720b0a3fba', '59d7118b-d7c8-4852-8445-738d4d1cac88', '73e12c6a-9e03-4903-9a91-a66552e2f505', 'cdeca986-d77d-4a2a-af79-509e8fe73824'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:24 devstack sudo[108748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:24 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:24 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:24 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:24 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.info" returned: 0 in 0.574s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.752s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:24 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Deleted volume successfully.
Aug 26 03:17:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-36c997f0-d4cb-4f1a-9da8-01e2f6dd88bd tempest-VolumeDependencyTests-783388463 None] Create snapshot completed successfully
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4089b597-b0fa-4ca9-bb26-96f4c9c56409 tempest-VolumesListAdminTestJSON-1732288975 None] Lock "cinder-42c16240-5460-41d2-8c6d-384aa4226356-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:24 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.459s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Deleted volume successfully.
Aug 26 03:17:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9043702d-722f-432c-9110-5f9af165c4f3 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-c6822415-58f4-4828-abe9-3d22fae85d84-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "cinder-4bbed92e-7919-48f5-bdca-2cb5d8266b7c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-4bbed92e-7919-48f5-bdca-2cb5d8266b7c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "cinder-quobyte-4bbed92e-7919-48f5-bdca-2cb5d8266b7c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-quobyte-4bbed92e-7919-48f5-bdca-2cb5d8266b7c" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a37bf2-5c6c-4f32-94f1-17d11eb2fced]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:25 devstack sudo[108757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c
Aug 26 03:17:25 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:25 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c" returned: 0 in 0.452s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:25 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c
Aug 26 03:17:25 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Flow 'volume_create_manager' (b04a5b58-ca81-44d4-8265-297d55850afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307528bd-75b1-43f6-94e4-f0a58d83e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307528bd-75b1-43f6-94e4-f0a58d83e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385836380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621e1b80-402c-48ef-9519-91824c5aabf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710a56ef3f1d4efe87e908783d76f883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bfcff41-8b61-4d52-94e5-7afb4d9e24f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:26Z,use_quota=True,user_id='b334f88c695447d5a2ac64746a4ead8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c42576-19d9-482d-9e4d-0600bf586948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c42576-19d9-482d-9e4d-0600bf586948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159a957c-7c8e-45df-a88f-94ce39ff9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159a957c-7c8e-45df-a88f-94ce39ff9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '621e1b80-402c-48ef-9519-91824c5aabf9', 'volume_name': 'volume-621e1b80-402c-48ef-9519-91824c5aabf9', 'volume_size': 1, 'snapshot_id': '3bfcff41-8b61-4d52-94e5-7afb4d9e24f6'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce14e9c-50d6-4a9b-8f65-1900041caf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce14e9c-50d6-4a9b-8f65-1900041caf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0fa08f-bdde-445d-8e95-2de32f071857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:26 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Volume 621e1b80-402c-48ef-9519-91824c5aabf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-621e1b80-402c-48ef-9519-91824c5aabf9', 'volume_size': 1, 'snapshot_id': '3bfcff41-8b61-4d52-94e5-7afb4d9e24f6'}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-quobyte-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6-621e1b80-402c-48ef-9519-91824c5aabf9" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6-621e1b80-402c-48ef-9519-91824c5aabf9" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Creating volume 621e1b80-402c-48ef-9519-91824c5aabf9 from snapshot 3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-quobyte-621e1b80-402c-48ef-9519-91824c5aabf9" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-621e1b80-402c-48ef-9519-91824c5aabf9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] snapshot: 3bfcff41-8b61-4d52-94e5-7afb4d9e24f6, volume: 621e1b80-402c-48ef-9519-91824c5aabf9,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:17:26 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4bbed92e-7919-48f5-bdca-2cb5d8266b7c" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-quobyte-4bbed92e-7919-48f5-bdca-2cb5d8266b7c" released by "delete_volume" :: held 0.944s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6ae10e-3c9a-4ee3-a68b-1352e16282c9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Created reservations ['c4f6652f-c686-4aba-b58c-acc3c277bfaf', '8cf28983-bf8f-461c-95a3-46cd7d28898b', '4eada808-4e41-41e8-839d-4cf8c31b1c59', 'a502e33f-277e-4386-8e80-c458a2a5dc07'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:26 devstack sudo[108765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6
Aug 26 03:17:26 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:26 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:26 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:26 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:26 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.319s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" returned: 0 in 0.569s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d244888-a60e-4b92-abd3-06f4a16d2723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:17:26 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Deleted volume successfully.
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c9008-3687-49dd-8e1e-62984bfab1f7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3aff60ac-e304-407b-abe5-ea003e1dd54f tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-4bbed92e-7919-48f5-bdca-2cb5d8266b7c-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:26 devstack sudo[108773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723
Aug 26 03:17:26 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:27 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:27 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9
Aug 26 03:17:27 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "cinder-0766c713-0941-4153-9fbc-3656d384775d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-0766c713-0941-4153-9fbc-3656d384775d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "cinder-quobyte-0766c713-0941-4153-9fbc-3656d384775d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-quobyte-0766c713-0941-4153-9fbc-3656d384775d" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97f9dcd-1630-4884-9f98-a1bcfd2d4fa7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:27 devstack sudo[108784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d
Aug 26 03:17:27 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:28 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d" returned: 0 in 0.773s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:28 devstack sudo[108795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d
Aug 26 03:17:28 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:28 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0766c713-0941-4153-9fbc-3656d384775d" returned: 0 in 0.404s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-quobyte-0766c713-0941-4153-9fbc-3656d384775d" released by "delete_volume" :: held 1.247s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Created reservations ['0f921d44-fb74-4735-99ee-c095645b712a', '5ad749ef-4bfb-4f66-a676-ed9f06134ad6', '365d0edd-a53d-4f0d-960e-2c0b3f1d7aed', '1d7362a4-c042-4b6f-af95-c8403d29d372'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:29 devstack sudo[108799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:29 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:29 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.597s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Deleted volume successfully.
Aug 26 03:17:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0d0f2e94-6818-4a75-bd2c-d4dc9cc76e61 tempest-VolumesListAdminTestJSON-1290057043 None] Lock "cinder-0766c713-0941-4153-9fbc-3656d384775d-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:33 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9" returned: 0 in 5.879s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:17:33 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Converted 1024.00 MB image at 174.15 MB/s
Aug 26 03:17:33 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 is being set with open permissions: ugo+rw
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:33 devstack sudo[108803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9
Aug 26 03:17:33 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:33 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9" returned: 0 in 0.272s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-621e1b80-402c-48ef-9519-91824c5aabf9" released by "_copy_volume_from_snapshot" :: held 7.262s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6-621e1b80-402c-48ef-9519-91824c5aabf9" released by "_create_volume_from_snapshot" :: held 7.335s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.354s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.203s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0fa08f-bdde-445d-8e95-2de32f071857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621e1b80-402c-48ef-9519-91824c5aabf9', 'volume_size': 1, 'snapshot_id': '3bfcff41-8b61-4d52-94e5-7afb4d9e24f6'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ab5964-5d70-4c7c-9c07-2516c0e9ea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ae7ed-9816-4614-80ec-52f87ed30bd5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Volume volume-621e1b80-402c-48ef-9519-91824c5aabf9 (621e1b80-402c-48ef-9519-91824c5aabf9): created successfully
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ab5964-5d70-4c7c-9c07-2516c0e9ea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Flow 'volume_create_manager' (b04a5b58-ca81-44d4-8265-297d55850afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-39bfed9c-11b0-4dca-9b51-1b18d6f6325c tempest-VolumeDependencyTests-783388463 None] Created volume successfully.
Aug 26 03:17:33 devstack sudo[108806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:17:33 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Lock "cinder-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-quobyte-3d244888-a60e-4b92-abd3-06f4a16d2723" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3d244888-a60e-4b92-abd3-06f4a16d2723" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-quobyte-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Deleting offline snapshot 3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 of volume 3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] snapshot_file for this snap is: volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a90d5-e4e2-4334-8688-6a5299a3e8a5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:33 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.541s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:33 devstack sudo[108808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6
Aug 26 03:17:33 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663c439-3683-4460-9991-125ae8b24363]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:34 devstack sudo[108814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:17:34 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:34 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" returned: 0 in 0.527s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d244888-a60e-4b92-abd3-06f4a16d2723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b91c32-4298-46f0-9f50-0a052f84b185]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:34 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.485s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.51a4b747-c90a-4acf-a3b4-b69ba229efdemjyiq4vl.img {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:34 devstack sudo[108823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.51a4b747-c90a-4acf-a3b4-b69ba229efdemjyiq4vl.img
Aug 26 03:17:34 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:34 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723
Aug 26 03:17:34 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:35 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723" returned: 0 in 0.856s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:35 devstack sudo[108840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6
Aug 26 03:17:35 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:36 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" returned: 0 in 0.986s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:36 devstack sudo[108846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6
Aug 26 03:17:36 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:36 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723.3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" returned: 0 in 0.494s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6" released by "_delete_snapshot" :: held 3.050s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3d244888-a60e-4b92-abd3-06f4a16d2723" released by "delete_snapshot" :: held 3.088s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:37 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Created reservations ['1b73eea8-d3c2-45ea-a972-bd4ed9867a65', '93baddb8-f1be-4370-9c21-82b25e01b708', 'd51317bf-a028-48f6-ad8c-6b6e8750b563', '35f34940-e9da-44e6-a2fe-bcb051419798'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Delete snapshot completed successfully.
Aug 26 03:17:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-23029cbb-6b84-4e9e-afba-bb6abdf381de tempest-VolumeDependencyTests-783388463 None] Lock "cinder-3bfcff41-8b61-4d52-94e5-7afb4d9e24f6-delete_snapshot" released by "delete_snapshot" :: held 3.460s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-3d244888-a60e-4b92-abd3-06f4a16d2723-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Lock "cinder-3d244888-a60e-4b92-abd3-06f4a16d2723-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-quobyte-3d244888-a60e-4b92-abd3-06f4a16d2723" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3d244888-a60e-4b92-abd3-06f4a16d2723" acquired by "delete_volume" :: waited 0.063s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[deab66d8-2588-4e75-924c-8d611a9cc96f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:39 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723
Aug 26 03:17:39 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:40 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723" returned: 0 in 1.090s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:40 devstack sudo[108856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723
Aug 26 03:17:40 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:40 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.51a4b747-c90a-4acf-a3b4-b69ba229efdemjyiq4vl.img" returned: 0 in 5.808s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4f11e-cb0a-479b-86d8-00c088beaa87]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:40 devstack sudo[108858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:17:40 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:40 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3d244888-a60e-4b92-abd3-06f4a16d2723" returned: 0 in 0.601s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-3d244888-a60e-4b92-abd3-06f4a16d2723" released by "delete_volume" :: held 1.895s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=103,cinder:SELECT=96,cinder:INSERT=24,cinder:DELETE=6 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Created reservations ['70f1dedf-7e33-4a68-b239-412fb67bf90c', '47cecd52-884e-4425-bbbd-187da69a6553', '829e585c-ac98-403f-85c3-f5b49b977e2d', '03c4c332-0193-4e0c-946d-c8204347de54'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:41 devstack sudo[108863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:41 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:41 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.910s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.51a4b747-c90a-4acf-a3b4-b69ba229efdemjyiq4vl.img {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:17:41 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Converted 1024.00 MB image at 176.26 MB/s
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Flow 'volume_create_manager' (4df2f970-1a3e-4cd5-9c43-dcde7211841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f611e-8c67-47c2-9eef-2b96fa2ac357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] 51a4b747-c90a-4acf-a3b4-b69ba229efde was raw, no need to convert to raw {{(pid=94326) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f611e-8c67-47c2-9eef-2b96fa2ac357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-171891120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0377f819-bb02-401a-86f4-89d370e2596f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe23ac5c1f41e9b8c18dd50329c3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:41Z,use_quota=True,user_id='32a15403859e40f587b9c2044c08189c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a508c87-5503-4a3b-83ea-dbe6a2e56ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a508c87-5503-4a3b-83ea-dbe6a2e56ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39795355-0eba-4741-a7d1-c946225d72bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39795355-0eba-4741-a7d1-c946225d72bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0377f819-bb02-401a-86f4-89d370e2596f', 'volume_name': 'volume-0377f819-bb02-401a-86f4-89d370e2596f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebe61f5-c72f-46ac-a2de-cd4ab6a2c567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebe61f5-c72f-46ac-a2de-cd4ab6a2c567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f334b482-6079-4a4a-95fc-94b553d3e429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Volume 0377f819-bb02-401a-86f4-89d370e2596f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0377f819-bb02-401a-86f4-89d370e2596f', 'volume_size': 1}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:41 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Deleted volume successfully.
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5b72e95-89b8-4d57-a422-f0f278eda7bc tempest-VolumeDependencyTests-783388463 None] Lock "cinder-3d244888-a60e-4b92-abd3-06f4a16d2723-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-621e1b80-402c-48ef-9519-91824c5aabf9-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Lock "cinder-621e1b80-402c-48ef-9519-91824c5aabf9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Acquiring lock "cinder-quobyte-621e1b80-402c-48ef-9519-91824c5aabf9" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-621e1b80-402c-48ef-9519-91824c5aabf9" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed17f75-8b56-463e-8d84-9f24137df77f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:42 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9
Aug 26 03:17:42 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:42 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9" returned: 0 in 0.714s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:42 devstack sudo[108909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9
Aug 26 03:17:42 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:43 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-621e1b80-402c-48ef-9519-91824c5aabf9" returned: 0 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Lock "cinder-quobyte-621e1b80-402c-48ef-9519-91824c5aabf9" released by "delete_volume" :: held 1.137s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Created reservations ['8fa916c8-f2dc-455b-ae2e-11ee27835e8e', '7edd4b69-ec45-4810-991d-25a1f55ca80a', 'd5cf9673-65b9-4b92-9031-c71a0ae6a16e', 'd6a65d59-fb24-4b2a-9581-65ad8848476f'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:17:43 devstack sudo[108912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:17:43 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:17:43 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.348s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:17:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Deleted volume successfully.
Aug 26 03:17:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77d9b269-5d51-464b-8915-78fdd7f44ea9 tempest-VolumeDependencyTests-783388463 None] Lock "cinder-621e1b80-402c-48ef-9519-91824c5aabf9-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Flow 'volume_create_manager' (ab732da1-51b6-4573-b137-cc0fe12baff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f972b044-5eba-428d-9b46-d4d23e775326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f972b044-5eba-428d-9b46-d4d23e775326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185981122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c584ed2-3115-478e-bde1-70c965475f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ea161f658c4de7bdb9e63413e3c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:51Z,use_quota=True,user_id='e6920d141cd44d39b91f668f5002c3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd204bb7-6d74-46b4-af63-db3ab1100b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd204bb7-6d74-46b4-af63-db3ab1100b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544119e2-cbb6-470e-98eb-e8d01b8acbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544119e2-cbb6-470e-98eb-e8d01b8acbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c584ed2-3115-478e-bde1-70c965475f7a', 'volume_name': 'volume-8c584ed2-3115-478e-bde1-70c965475f7a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15f5bc0-bdcd-46c4-b509-4597e7f6ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15f5bc0-bdcd-46c4-b509-4597e7f6ca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5ba4cf-1d1b-407b-968d-68474e6de625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:50 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Volume 8c584ed2-3115-478e-bde1-70c965475f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c584ed2-3115-478e-bde1-70c965475f7a', 'volume_size': 1}
Aug 26 03:17:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:57 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Flow 'volume_create_manager' (c63a6663-833b-42ab-b3b9-92a707801117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8e1417-e489-4743-8332-0084cc1a0339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8e1417-e489-4743-8332-0084cc1a0339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1825420234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4d7092c304a51876b39e11dcef81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:58Z,use_quota=True,user_id='9620c2ce3fd047278bf6c3aec270c811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60494585-e35e-45f5-bdb1-1bb8fd54cbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60494585-e35e-45f5-bdb1-1bb8fd54cbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1d699b-bb46-4239-8f20-c1f23da7f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1d699b-bb46-4239-8f20-c1f23da7f96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1', 'volume_name': 'volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba89bcd-b0a8-4da7-820c-066f29109649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba89bcd-b0a8-4da7-820c-066f29109649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93201e3a-b75a-49bf-a98d-0e4aa2b56779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Volume a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1', 'volume_size': 1}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Flow 'volume_create_manager' (56b1d8ad-b6bb-4c2b-89fd-f3f6560c8b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ae834-4a8d-49cf-98e3-0dd098348d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ae834-4a8d-49cf-98e3-0dd098348d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-469056484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed3bb16-7201-4c34-88ca-fe85e70bc25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4d7092c304a51876b39e11dcef81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:58Z,use_quota=True,user_id='9620c2ce3fd047278bf6c3aec270c811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde01363-dc4a-4868-9d39-f7a13ebc06b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde01363-dc4a-4868-9d39-f7a13ebc06b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f68cc41-979f-48b0-a6c4-0d08be3796d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f68cc41-979f-48b0-a6c4-0d08be3796d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed3bb16-7201-4c34-88ca-fe85e70bc25f', 'volume_name': 'volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf513e2f-512c-4fd2-b965-2633bc45bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf513e2f-512c-4fd2-b965-2633bc45bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449f07f2-ed53-4e88-ade6-4a065a5e693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:17:58 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Volume aed3bb16-7201-4c34-88ca-fe85e70bc25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f', 'volume_size': 1}
Aug 26 03:17:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.053s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Uploaded volume to glance image-id: 51a4b747-c90a-4acf-a3b4-b69ba229efde. {{(pid=94326) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.093s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-171891120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0377f819-bb02-401a-86f4-89d370e2596f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe23ac5c1f41e9b8c18dd50329c3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:41Z,use_quota=True,user_id='32a15403859e40f587b9c2044c08189c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Creating volume 0377f819-bb02-401a-86f4-89d370e2596f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:05 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:05 devstack sudo[108979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f 1073741824
Aug 26 03:18:05 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-11ceaaa7-2121-4b4e-baf2-791306c58bb1 tempest-VolumesActionsTest-1832454505 None] Copy volume to image completed successfully.
Aug 26 03:18:06 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f 1073741824" returned: 0 in 0.684s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:06 devstack sudo[109014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f
Aug 26 03:18:06 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:06 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f" returned: 0 in 0.307s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.802s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185981122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c584ed2-3115-478e-bde1-70c965475f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ea161f658c4de7bdb9e63413e3c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:51Z,use_quota=True,user_id='e6920d141cd44d39b91f668f5002c3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Creating volume 8c584ed2-3115-478e-bde1-70c965475f7a {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:06 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:06 devstack sudo[109030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a 1073741824
Aug 26 03:18:06 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f334b482-6079-4a4a-95fc-94b553d3e429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0377f819-bb02-401a-86f4-89d370e2596f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6daad18-e8b2-44d3-83e2-d7e2582fe7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:06 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Volume volume-0377f819-bb02-401a-86f4-89d370e2596f (0377f819-bb02-401a-86f4-89d370e2596f): created successfully
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6daad18-e8b2-44d3-83e2-d7e2582fe7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Flow 'volume_create_manager' (4df2f970-1a3e-4cd5-9c43-dcde7211841f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9687a025-f49d-4318-8d38-bfdb0dd365fa tempest-VolumesTransfersV355Test-1046420929 None] Created volume successfully.
Aug 26 03:18:07 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a 1073741824" returned: 0 in 0.539s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:07 devstack sudo[109045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a
Aug 26 03:18:07 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:07 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a" returned: 0 in 0.334s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.374s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1825420234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4d7092c304a51876b39e11dcef81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:58Z,use_quota=True,user_id='9620c2ce3fd047278bf6c3aec270c811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Creating volume a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:07 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5ba4cf-1d1b-407b-968d-68474e6de625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c584ed2-3115-478e-bde1-70c965475f7a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:07 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 1073741824
Aug 26 03:18:07 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bdebf8-2be7-4686-90e0-4c4faf12bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:07 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Volume volume-8c584ed2-3115-478e-bde1-70c965475f7a (8c584ed2-3115-478e-bde1-70c965475f7a): created successfully
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bdebf8-2be7-4686-90e0-4c4faf12bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Flow 'volume_create_manager' (ab732da1-51b6-4573-b137-cc0fe12baff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4d8cc52e-ae10-4fb6-b700-31e79b515170 tempest-ProjectReaderTests-637541726 None] Created volume successfully.
Aug 26 03:18:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e46f50db-d0da-4957-b8ca-88b765d5c244 tempest-VolumesTransfersV355Test-1025533382 None] Transfer volume completed successfully.
Aug 26 03:18:08 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 1073741824" returned: 0 in 0.844s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Acquiring lock "cinder-8c584ed2-3115-478e-bde1-70c965475f7a-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:08 devstack sudo[109056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1
Aug 26 03:18:08 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Lock "cinder-8c584ed2-3115-478e-bde1-70c965475f7a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Acquiring lock "cinder-quobyte-8c584ed2-3115-478e-bde1-70c965475f7a" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Lock "cinder-quobyte-8c584ed2-3115-478e-bde1-70c965475f7a" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf868f-8758-41f3-88eb-c9b93a4b26b4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:08 devstack sudo[109058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a
Aug 26 03:18:08 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:08 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1" returned: 0 in 0.400s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.341s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-469056484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed3bb16-7201-4c34-88ca-fe85e70bc25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee4d7092c304a51876b39e11dcef81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:58Z,use_quota=True,user_id='9620c2ce3fd047278bf6c3aec270c811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Creating volume aed3bb16-7201-4c34-88ca-fe85e70bc25f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:08 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:08 devstack sudo[109061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f 1073741824
Aug 26 03:18:08 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93201e3a-b75a-49bf-a98d-0e4aa2b56779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71400505-d82c-49e2-9195-6005440495d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Volume volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 (a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1): created successfully
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71400505-d82c-49e2-9195-6005440495d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Flow 'volume_create_manager' (c63a6663-833b-42ab-b3b9-92a707801117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3c401f09-d87b-479a-b6c5-25079febf093 tempest-TestServerVolumeAttachmentScenario-547594335 None] Created volume successfully.
Aug 26 03:18:09 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a" returned: 0 in 0.586s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:09 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a
Aug 26 03:18:09 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:09 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f 1073741824" returned: 0 in 0.703s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:09 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-8c584ed2-3115-478e-bde1-70c965475f7a" returned: 0 in 0.409s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Lock "cinder-quobyte-8c584ed2-3115-478e-bde1-70c965475f7a" released by "delete_volume" :: held 1.064s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Acquiring lock "cinder-0377f819-bb02-401a-86f4-89d370e2596f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Created reservations ['9130f6f1-7f16-4c50-8a97-b4c162bca7c5', '6ceda603-5b06-4269-b68b-85babd3bb67c', '7b1b90d0-ed23-4ef3-9ee7-10ddfcc18a35', '32c63154-fef0-4a8f-bec0-c307a00e2142'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:09 devstack sudo[109075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f
Aug 26 03:18:09 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-0377f819-bb02-401a-86f4-89d370e2596f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Acquiring lock "cinder-quobyte-0377f819-bb02-401a-86f4-89d370e2596f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-quobyte-0377f819-bb02-401a-86f4-89d370e2596f" acquired by "delete_volume" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d6f4c7-3d81-4851-a54b-a07e437dccbe]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:10 devstack sudo[109077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:10 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:10 devstack sudo[109078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f
Aug 26 03:18:10 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:10 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f" returned: 0 in 0.453s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.771s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449f07f2-ed53-4e88-ade6-4a065a5e693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3da8ac-4e7c-4d08-977e-7013d219026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d4201f-d618-4575-9bbb-6e22cc5281e3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Volume volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f (aed3bb16-7201-4c34-88ca-fe85e70bc25f): created successfully
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3da8ac-4e7c-4d08-977e-7013d219026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Flow 'volume_create_manager' (56b1d8ad-b6bb-4c2b-89fd-f3f6560c8b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c574ed38-07f2-45b1-9863-fdac5cb80129 tempest-TestServerVolumeAttachmentScenario-547594335 None] Created volume successfully.
Aug 26 03:18:10 devstack sudo[109082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:18:10 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:10 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.545s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Deleted volume successfully.
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f4972372-8efe-4992-b84f-187306754083 tempest-ProjectReaderTests-637541726 None] Lock "cinder-8c584ed2-3115-478e-bde1-70c965475f7a-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:10 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f" returned: 0 in 0.662s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:10 devstack sudo[109090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f
Aug 26 03:18:10 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:11 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.781s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93512f2-6643-44f4-80c8-099543cedbd4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:11 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0377f819-bb02-401a-86f4-89d370e2596f" returned: 0 in 0.558s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-quobyte-0377f819-bb02-401a-86f4-89d370e2596f" released by "delete_volume" :: held 1.307s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:11 devstack sudo[109095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:18:11 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Created reservations ['97f694ff-5422-41ab-b3f4-f3081b0f6773', '893d7a11-a430-4397-bd98-59a93d9759ed', '4985c033-4962-498f-9d19-f9fa8bc55754', '7a05ceab-14be-4bb6-b85c-78cdaaf76119'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:11 devstack sudo[109100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:11 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:11 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.594s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:11 devstack sudo[109105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img
Aug 26 03:18:11 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Flow 'volume_create_manager' (941b9c3a-0faa-47d5-8615-01442c7bdcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37886cb8-509f-4785-b1b7-1f331ce9c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37886cb8-509f-4785-b1b7-1f331ce9c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1241477265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7c171a-a37c-4fd7-a673-552124bda55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ea161f658c4de7bdb9e63413e3c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:12Z,use_quota=True,user_id='e6920d141cd44d39b91f668f5002c3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39c46f8-5490-43f9-951c-d860ae73771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39c46f8-5490-43f9-951c-d860ae73771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be08c40c-25fa-4fcf-a019-6e961c26acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be08c40c-25fa-4fcf-a019-6e961c26acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7c171a-a37c-4fd7-a673-552124bda55a', 'volume_name': 'volume-ba7c171a-a37c-4fd7-a673-552124bda55a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0792ac0a-71d2-43f0-a79e-41eda4f84169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0792ac0a-71d2-43f0-a79e-41eda4f84169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71183a74-d794-426d-9d58-5a881c3b396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Volume ba7c171a-a37c-4fd7-a673-552124bda55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7c171a-a37c-4fd7-a673-552124bda55a', 'volume_size': 1}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:11 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.391s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:11 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Deleted volume successfully.
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b60e57b2-6f58-488e-8359-7a4f7d58dff1 tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-0377f819-bb02-401a-86f4-89d370e2596f-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:12 devstack sudo[109118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:12 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:13 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.746s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:18:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:18:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:18:13 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Flow 'volume_create_manager' (2256672a-ff1e-4f6b-b2a5-37d4605a2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9ddf44-c264-4df8-895d-3d6dfc8f49ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9ddf44-c264-4df8-895d-3d6dfc8f49ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-689865012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817a7a14-22b6-45ec-a701-bfda6253dc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe23ac5c1f41e9b8c18dd50329c3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:14Z,use_quota=True,user_id='32a15403859e40f587b9c2044c08189c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71772a8-60cc-4c93-9715-519fffc3e66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71772a8-60cc-4c93-9715-519fffc3e66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7a7a4a-8be7-46ff-a4bd-219548ec0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7a7a4a-8be7-46ff-a4bd-219548ec0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817a7a14-22b6-45ec-a701-bfda6253dc7d', 'volume_name': 'volume-817a7a14-22b6-45ec-a701-bfda6253dc7d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263bf4ed-dafa-43b6-9568-77b0f627e114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263bf4ed-dafa-43b6-9568-77b0f627e114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec8c317-b17b-4fd2-ac45-7474ea011257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Volume 817a7a14-22b6-45ec-a701-bfda6253dc7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817a7a14-22b6-45ec-a701-bfda6253dc7d', 'volume_size': 1}
Aug 26 03:18:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:17 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img" returned: 0 in 5.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b79034-24a3-4050-b43e-fd51f1f4b1b7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:17 devstack sudo[109125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:18:17 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:17 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.523s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:18:17 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Converted 1024.00 MB image at 188.11 MB/s
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] d04d4db8-cb60-47c5-bdc9-9573d2b3bb7d was raw, converting to qcow2 {{(pid=94326) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9726857-27a7-43a6-be60-802b3c1e184e]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:17 devstack sudo[109130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img
Aug 26 03:18:17 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:18 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:18 devstack sudo[109134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img
Aug 26 03:18:18 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:18 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img" returned: 1 in 0.335s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img /opt/stack/data/cinder/conversion/vol_upload__bsyv440 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:18 devstack sudo[109139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img /opt/stack/data/cinder/conversion/vol_upload__bsyv440
Aug 26 03:18:18 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:18 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img /opt/stack/data/cinder/conversion/vol_upload__bsyv440" returned: 0 in 0.264s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Image conversion details: src /opt/stack/data/cinder/conversion/7e330343-7c16-4146-b9d0-2f4a1bda2853.temp_image.d04d4db8-cb60-47c5-bdc9-9573d2b3bb7dee2cgl7r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__bsyv440 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:18:18 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Converted 1024.00 MB image at 1024.00 MB/s
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0957f2f-4430-4f60-80d5-5d0ae8094d33]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__bsyv440 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:18 devstack sudo[109144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__bsyv440
Aug 26 03:18:18 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:19 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__bsyv440" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.075s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Uploaded volume to glance image-id: d04d4db8-cb60-47c5-bdc9-9573d2b3bb7d. {{(pid=94326) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.414s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1241477265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7c171a-a37c-4fd7-a673-552124bda55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3ea161f658c4de7bdb9e63413e3c26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:12Z,use_quota=True,user_id='e6920d141cd44d39b91f668f5002c3a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Creating volume ba7c171a-a37c-4fd7-a673-552124bda55a {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:20 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=95,cinder:DELETE=11,cinder:INSERT=25,cinder:SELECT=74 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:18:20 devstack sudo[109150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a 1073741824
Aug 26 03:18:20 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7b36504d-4133-44c3-8888-4017e44e43ff tempest-VolumesActionsTest-1832454505 None] Copy volume to image completed successfully.
Aug 26 03:18:20 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a 1073741824" returned: 0 in 0.456s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:20 devstack sudo[109155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a
Aug 26 03:18:20 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:21 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a" returned: 0 in 0.249s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.815s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-689865012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817a7a14-22b6-45ec-a701-bfda6253dc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efe23ac5c1f41e9b8c18dd50329c3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:14Z,use_quota=True,user_id='32a15403859e40f587b9c2044c08189c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Creating volume 817a7a14-22b6-45ec-a701-bfda6253dc7d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:21 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71183a74-d794-426d-9d58-5a881c3b396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7c171a-a37c-4fd7-a673-552124bda55a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58252f5b-6d21-4bf5-8b2b-c2cdc32b1d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:21 devstack sudo[109176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d 1073741824
Aug 26 03:18:21 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Volume volume-ba7c171a-a37c-4fd7-a673-552124bda55a (ba7c171a-a37c-4fd7-a673-552124bda55a): created successfully
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58252f5b-6d21-4bf5-8b2b-c2cdc32b1d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Flow 'volume_create_manager' (941b9c3a-0faa-47d5-8615-01442c7bdcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ca78270f-7fd6-4474-b799-772bf4628481 tempest-ProjectReaderTests-637541726 None] Created volume successfully.
Aug 26 03:18:21 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d 1073741824" returned: 0 in 0.514s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:21 devstack sudo[109182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d
Aug 26 03:18:21 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Acquiring lock "cinder-ba7c171a-a37c-4fd7-a673-552124bda55a-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Lock "cinder-ba7c171a-a37c-4fd7-a673-552124bda55a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:21 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d" returned: 0 in 0.294s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Acquiring lock "cinder-quobyte-ba7c171a-a37c-4fd7-a673-552124bda55a" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec8c317-b17b-4fd2-ac45-7474ea011257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817a7a14-22b6-45ec-a701-bfda6253dc7d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c3328c-eb22-498a-a624-19d2fb90154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Lock "cinder-quobyte-ba7c171a-a37c-4fd7-a673-552124bda55a" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:22 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Volume volume-817a7a14-22b6-45ec-a701-bfda6253dc7d (817a7a14-22b6-45ec-a701-bfda6253dc7d): created successfully
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c3328c-eb22-498a-a624-19d2fb90154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Flow 'volume_create_manager' (2256672a-ff1e-4f6b-b2a5-37d4605a2882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f053d5fd-fe47-4e32-92ec-242dd7f05bfa]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:22 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3d902f50-e641-4a71-8fd4-373d35ba957e tempest-VolumesTransfersV355Test-1046420929 None] Created volume successfully.
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Acquiring lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Acquiring lock "cinder-quobyte-7e330343-7c16-4146-b9d0-2f4a1bda2853" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Lock "cinder-quobyte-7e330343-7c16-4146-b9d0-2f4a1bda2853" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:22 devstack sudo[109185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a
Aug 26 03:18:22 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97396ed-08d5-4e09-909d-3abbbf1623ec]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:22 devstack sudo[109187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:18:22 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:22 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a" returned: 0 in 0.371s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:22 devstack sudo[109192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a
Aug 26 03:18:22 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:22 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:22 devstack sudo[109197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853
Aug 26 03:18:22 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:22 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba7c171a-a37c-4fd7-a673-552124bda55a" returned: 0 in 0.297s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Lock "cinder-quobyte-ba7c171a-a37c-4fd7-a673-552124bda55a" released by "delete_volume" :: held 0.716s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Created reservations ['11ec4424-00d4-4b2d-b70c-6f496d99d33c', '87383947-6da5-4559-b23e-68197e8fd6e1', '7dbfb3f7-2aa5-4b75-8c79-7d4ef148e7ba', 'fcfd8d3b-58e4-4124-9491-7fdd521d4f5d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:22 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e330343-7c16-4146-b9d0-2f4a1bda2853" returned: 0 in 0.285s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Lock "cinder-quobyte-7e330343-7c16-4146-b9d0-2f4a1bda2853" released by "delete_volume" :: held 0.715s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:22 devstack sudo[109201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:22 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Acquiring lock "cinder-817a7a14-22b6-45ec-a701-bfda6253dc7d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-817a7a14-22b6-45ec-a701-bfda6253dc7d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Acquiring lock "cinder-quobyte-817a7a14-22b6-45ec-a701-bfda6253dc7d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Created reservations ['7a59b82b-6d24-4673-93b7-7aa3a4799c75', '88cd872c-c20c-402d-b961-14541ad399d5', 'cf5679d6-6ea8-4273-bc3c-d8dff4ec671f', '9b6112a7-837c-47ec-96a5-23c86e0ed5e6'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-quobyte-817a7a14-22b6-45ec-a701-bfda6253dc7d" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71c2e2d-9ee8-4700-b53e-ce2b0d47a8c3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:23 devstack sudo[109204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:23 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:23 devstack sudo[109203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d
Aug 26 03:18:23 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:23 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.338s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Deleted volume successfully.
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dfa2fadc-9695-4359-a877-45927eee332f tempest-ProjectReaderTests-637541726 None] Lock "cinder-ba7c171a-a37c-4fd7-a673-552124bda55a-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:23 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Deleted volume successfully.
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0a1d6c73-d5c5-41fe-abc0-fda79038c85a tempest-VolumesActionsTest-1832454505 None] Lock "cinder-7e330343-7c16-4146-b9d0-2f4a1bda2853-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:23 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d" returned: 0 in 0.488s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:23 devstack sudo[109212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d
Aug 26 03:18:23 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:23 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-817a7a14-22b6-45ec-a701-bfda6253dc7d" returned: 0 in 0.272s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-quobyte-817a7a14-22b6-45ec-a701-bfda6253dc7d" released by "delete_volume" :: held 0.818s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Created reservations ['e0e45ab4-0c9c-49cf-9fbb-cafbc88ece56', 'e2efaff0-79d2-4c78-b56c-af43bc488825', '6c688c38-8e29-4d25-9aeb-3d009243a226', 'b17d74bc-ec19-4b49-964b-e0a63ec31a9a'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:23 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:23 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:24 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.355s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:24 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Deleted volume successfully.
Aug 26 03:18:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9c286b90-c798-4afe-a98c-be5b8f55e12c tempest-VolumesTransfersV355Test-2073381426 None] Lock "cinder-817a7a14-22b6-45ec-a701-bfda6253dc7d-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (3f9adb8a-7aec-41f6-ba10-073107aedc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9cab91-9ef0-4d63-9ab6-3706d8b4b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9cab91-9ef0-4d63-9ab6-3706d8b4b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-750342775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf9ec04-8ebb-4257-8788-603528ab117d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:32Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3a8233-8df1-433d-a74f-e850f8e6030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3a8233-8df1-433d-a74f-e850f8e6030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2c1a5c-d9f4-4404-8476-aa34adb28d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2c1a5c-d9f4-4404-8476-aa34adb28d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf9ec04-8ebb-4257-8788-603528ab117d', 'volume_name': 'volume-6bf9ec04-8ebb-4257-8788-603528ab117d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3222e25c-4315-4e38-b4b7-59231d1dbc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3222e25c-4315-4e38-b4b7-59231d1dbc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fef9daf-e81f-4ecd-a929-78193a8944d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Volume 6bf9ec04-8ebb-4257-8788-603528ab117d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf9ec04-8ebb-4257-8788-603528ab117d', 'volume_size': 1}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-750342775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf9ec04-8ebb-4257-8788-603528ab117d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:32Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Creating volume 6bf9ec04-8ebb-4257-8788-603528ab117d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:31 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:31 devstack sudo[109224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d 1073741824
Aug 26 03:18:31 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Flow 'volume_create_manager' (344e5486-6795-46af-8cd8-c28936c0e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee6df26-41f5-44ad-8e46-373d90e2e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee6df26-41f5-44ad-8e46-373d90e2e97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-125051311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea30b775-12f0-487c-b62c-c12c08dabe00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b282f6a27c9f42d3af925a206918563e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:32Z,use_quota=True,user_id='d3d441a33df747218b4e6b4b2c667535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e42eb8c-db06-49fc-ad8b-6781d956728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e42eb8c-db06-49fc-ad8b-6781d956728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492d5729-1a28-4cd6-80d5-70d233fc1f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492d5729-1a28-4cd6-80d5-70d233fc1f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea30b775-12f0-487c-b62c-c12c08dabe00', 'volume_name': 'volume-ea30b775-12f0-487c-b62c-c12c08dabe00', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dca0f54-045a-4702-bbe9-1813fcfa2c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dca0f54-045a-4702-bbe9-1813fcfa2c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b14af19-8e96-4447-86f6-d4b729d9ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Volume ea30b775-12f0-487c-b62c-c12c08dabe00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea30b775-12f0-487c-b62c-c12c08dabe00', 'volume_size': 1}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:32 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d 1073741824" returned: 0 in 0.553s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:32 devstack sudo[109233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d
Aug 26 03:18:32 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:32 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d" returned: 0 in 0.328s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-125051311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea30b775-12f0-487c-b62c-c12c08dabe00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b282f6a27c9f42d3af925a206918563e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:32Z,use_quota=True,user_id='d3d441a33df747218b4e6b4b2c667535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Creating volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:32 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fef9daf-e81f-4ecd-a929-78193a8944d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf9ec04-8ebb-4257-8788-603528ab117d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9c711d-f29b-43ca-82ca-c442924d3071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:32 devstack sudo[109244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 1073741824
Aug 26 03:18:32 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Volume volume-6bf9ec04-8ebb-4257-8788-603528ab117d (6bf9ec04-8ebb-4257-8788-603528ab117d): created successfully
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9c711d-f29b-43ca-82ca-c442924d3071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (3f9adb8a-7aec-41f6-ba10-073107aedc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b11621db-c8bf-4a74-bb8a-69de882a2ded tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:18:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-6bbe4751-e90a-47fa-8b7f-dfef0bc28e85 req-0e411e29-6b69-4272-a89e-f141bb19cb50 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:33 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 1073741824" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:33 devstack sudo[109250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00
Aug 26 03:18:33 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:33 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00" returned: 0 in 0.290s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-6bbe4751-e90a-47fa-8b7f-dfef0bc28e85 req-0e411e29-6b69-4272-a89e-f141bb19cb50 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.721s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-6bbe4751-e90a-47fa-8b7f-dfef0bc28e85 req-0e411e29-6b69-4272-a89e-f141bb19cb50 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b14af19-8e96-4447-86f6-d4b729d9ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea30b775-12f0-487c-b62c-c12c08dabe00', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cd7a04-5697-4781-831e-af2d5a90040e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Volume volume-ea30b775-12f0-487c-b62c-c12c08dabe00 (ea30b775-12f0-487c-b62c-c12c08dabe00): created successfully
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4cd7a04-5697-4781-831e-af2d5a90040e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Flow 'volume_create_manager' (344e5486-6795-46af-8cd8-c28936c0e76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d1de682b-fdb0-46af-b076-ca221588859f tempest-VolumesSnapshotListTestJSON-107469850 None] Created volume successfully.
Aug 26 03:18:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-6bbe4751-e90a-47fa-8b7f-dfef0bc28e85 req-0e411e29-6b69-4272-a89e-f141bb19cb50 tempest-TestServerVolumeAttachmentScenario-547594335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e402c0e5-6c0d-4876-a1df-e0d14b2f4302', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:18:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-6bbe4751-e90a-47fa-8b7f-dfef0bc28e85 req-0e411e29-6b69-4272-a89e-f141bb19cb50 tempest-TestServerVolumeAttachmentScenario-547594335 None] attachment_update completed successfully.
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (6cc96cec-f793-4081-b827-f730a9964894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4ec79a-5b3e-46af-aa5d-2e2ebc0b3adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4ec79a-5b3e-46af-aa5d-2e2ebc0b3adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951791228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adc84ae-653b-496b-abbe-a47474b333e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:35Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b5c310-1a06-4d3a-92b3-6b82f6145252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b5c310-1a06-4d3a-92b3-6b82f6145252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8bcd58-79c5-48af-b0d0-e1543779d0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8bcd58-79c5-48af-b0d0-e1543779d0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7adc84ae-653b-496b-abbe-a47474b333e7', 'volume_name': 'volume-7adc84ae-653b-496b-abbe-a47474b333e7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dc0f2d-910e-40c4-8693-e3ed6e679ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dc0f2d-910e-40c4-8693-e3ed6e679ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b4efb-d867-407c-b39c-109086034af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:34 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Volume 7adc84ae-653b-496b-abbe-a47474b333e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7adc84ae-653b-496b-abbe-a47474b333e7', 'volume_size': 1}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Creating offline snapshot b41a6fec-1a2f-4f26-a94d-71a29139bc41 of volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64c8d9-7e87-4e15-a7ad-be05fbafbd02]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:34 devstack sudo[109639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00
Aug 26 03:18:34 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:35 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (e97d3735-82fe-452e-a379-99d10ae18b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994ac9da-cb91-493d-a5c4-cf28d02ff5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00" returned: 0 in 0.483s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:35 devstack sudo[109644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 1G
Aug 26 03:18:35 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994ac9da-cb91-493d-a5c4-cf28d02ff5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-754702955',display_name='tempest-VolumesGetTest-Volume-1013250874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:35Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0895583e-bbdb-4628-be3b-f3d2b0b2be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0895583e-bbdb-4628-be3b-f3d2b0b2be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae78c9cc-c6b4-48b5-bf38-fa722290c9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae78c9cc-c6b4-48b5-bf38-fa722290c9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8', 'volume_name': 'volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3b8ecd-d2c7-401b-91af-379aefb1a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3b8ecd-d2c7-401b-91af-379aefb1a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef333d1-2466-45ab-b20a-eb0aff1c83f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:35 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Volume f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8', 'volume_size': 1}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:35 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 1G" returned: 0 in 0.452s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:35 devstack sudo[109650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:35 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:35 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.281s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:35 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 is being set with open permissions: ugo+rw
Aug 26 03:18:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:35 devstack sudo[109655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:35 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:36 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.260s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:36 devstack sudo[109658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info
Aug 26 03:18:36 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:36 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:36 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info is being set with open permissions: ugo+rw
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:36 devstack sudo[109661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info
Aug 26 03:18:36 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:36 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.info" returned: 0 in 0.262s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.075s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951791228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adc84ae-653b-496b-abbe-a47474b333e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:35Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Creating volume 7adc84ae-653b-496b-abbe-a47474b333e7 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:36 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:36 devstack sudo[109664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7 1073741824
Aug 26 03:18:36 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6ae651a8-df82-4c75-a761-56e21d4aeded tempest-VolumesSnapshotListTestJSON-107469850 None] Create snapshot completed successfully
Aug 26 03:18:37 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7 1073741824" returned: 0 in 0.463s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:37 devstack sudo[109673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7
Aug 26 03:18:37 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:37 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7" returned: 0 in 0.263s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.272s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-754702955',display_name='tempest-VolumesGetTest-Volume-1013250874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:35Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Creating volume f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:37 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:37 devstack sudo[109681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 1073741824
Aug 26 03:18:37 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b4efb-d867-407c-b39c-109086034af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7adc84ae-653b-496b-abbe-a47474b333e7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619dddab-e9c0-44f1-ada4-38109ec5d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Volume volume-7adc84ae-653b-496b-abbe-a47474b333e7 (7adc84ae-653b-496b-abbe-a47474b333e7): created successfully
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619dddab-e9c0-44f1-ada4-38109ec5d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (6cc96cec-f793-4081-b827-f730a9964894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-788275da-2212-4bc7-8231-c2f56262b4c5 tempest-ProjectReaderTests-301140939 None] Created volume successfully.
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-76bc0393-aeb1-4363-ae30-e6000c6727ea req-9d5dec72-6acb-4dd8-b5c4-c833bd4c4933 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:38 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 1073741824" returned: 0 in 0.473s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:38 devstack sudo[109690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8
Aug 26 03:18:38 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:38 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8" returned: 0 in 0.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-76bc0393-aeb1-4363-ae30-e6000c6727ea req-9d5dec72-6acb-4dd8-b5c4-c833bd4c4933 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.537s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef333d1-2466-45ab-b20a-eb0aff1c83f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63e5fb7-07ac-4a9b-9992-1f0b3e7eed66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-76bc0393-aeb1-4363-ae30-e6000c6727ea req-9d5dec72-6acb-4dd8-b5c4-c833bd4c4933 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.470s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:38 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Volume volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 (f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8): created successfully
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63e5fb7-07ac-4a9b-9992-1f0b3e7eed66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (e97d3735-82fe-452e-a379-99d10ae18b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Creating offline snapshot 852a1a49-d203-4631-9e27-3847ef0bd36b of volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:18:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8007962e-aa12-4425-a11a-7624dad33572 tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa431751-31d9-4603-b00e-1ea13990b089]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-76bc0393-aeb1-4363-ae30-e6000c6727ea req-9d5dec72-6acb-4dd8-b5c4-c833bd4c4933 tempest-TestServerVolumeAttachmentScenario-547594335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3fe88a8-3c90-4ad8-93fd-df12c1d4b70a', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:18:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-76bc0393-aeb1-4363-ae30-e6000c6727ea req-9d5dec72-6acb-4dd8-b5c4-c833bd4c4933 tempest-TestServerVolumeAttachmentScenario-547594335 None] attachment_update completed successfully.
Aug 26 03:18:38 devstack sudo[109693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:38 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:38 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.397s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:38 devstack sudo[109703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b 1G
Aug 26 03:18:38 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-7adc84ae-653b-496b-abbe-a47474b333e7-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Lock "cinder-7adc84ae-653b-496b-abbe-a47474b333e7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-quobyte-7adc84ae-653b-496b-abbe-a47474b333e7" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-7adc84ae-653b-496b-abbe-a47474b333e7" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[242fed80-609d-4896-b2fd-cf6bbb9ef591]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:39 devstack sudo[109709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7
Aug 26 03:18:39 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:39 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b 1G" returned: 0 in 0.541s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:39 devstack sudo[109712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:39 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:39 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7" returned: 0 in 0.399s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:39 devstack sudo[109717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7
Aug 26 03:18:39 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Lock "cinder-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:39 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.357s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:39 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b is being set with open permissions: ugo+rw
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b6dcc5-48a6-4dd0-b73e-046bcb51eca8]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:39 devstack sudo[109722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:39 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:39 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7adc84ae-653b-496b-abbe-a47474b333e7" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:39 devstack sudo[109723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8
Aug 26 03:18:39 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-7adc84ae-653b-496b-abbe-a47474b333e7" released by "delete_volume" :: held 0.795s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:39 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Created reservations ['7727c19e-42c4-420d-a4f3-f4984b2eeacf', '46ba0e5a-d5d3-42e6-a827-6ec2e2db86f0', '24f2ed0a-ab11-4f64-abb4-eb2dc4483254', '39b32e4a-c78a-4a18-8c64-6e40c757f010'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:40 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:40 devstack sudo[109728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:40 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.770s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8b12edb7-e449-4361-b935-32f93d7f056c tempest-VolumesSnapshotListTestJSON-107469850 None] Create snapshot completed successfully
Aug 26 03:18:40 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8" returned: 0 in 0.506s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:40 devstack sudo[109733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8
Aug 26 03:18:40 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:40 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Deleted volume successfully.
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-720cd22f-3e63-463b-9021-088cf250e0c4 tempest-ProjectReaderTests-301140939 None] Lock "cinder-7adc84ae-653b-496b-abbe-a47474b333e7-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:40 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8" released by "delete_volume" :: held 0.918s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Created reservations ['1bce53d6-6a62-4ba1-833e-b9ce1b0eeca5', '43e06193-9a55-42e4-bc22-a75950e77d29', 'e79a6d6b-1397-4ca5-bda7-22e9b969acc4', '13e452a0-9335-4551-ac23-3d6c9ca36ed8'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=83,cinder:INSERT=17,cinder:UPDATE=110,cinder:DELETE=11 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:40 devstack sudo[109742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:40 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (9390d895-0662-43c3-ab57-6900cc23f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94ad7b6-403c-4a79-83c8-c894020da4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94ad7b6-403c-4a79-83c8-c894020da4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009304847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff8139d-13b0-4c2a-9b45-29045bb0da2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:41Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f6f0a-337a-4132-9b94-993840792179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f6f0a-337a-4132-9b94-993840792179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed56d7b-9a1f-4388-a048-bc369dc5a799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed56d7b-9a1f-4388-a048-bc369dc5a799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff8139d-13b0-4c2a-9b45-29045bb0da2e', 'volume_name': 'volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f08d8d-b063-4531-bc60-297503508c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f08d8d-b063-4531-bc60-297503508c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f6c6d8-a831-4882-a263-247eef89c921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:40 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Volume 5ff8139d-13b0-4c2a-9b45-29045bb0da2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e', 'volume_size': 1}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009304847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff8139d-13b0-4c2a-9b45-29045bb0da2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:41Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Creating volume 5ff8139d-13b0-4c2a-9b45-29045bb0da2e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:40 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-629f64ad-46b0-4a21-8897-3b2b9714522a req-3282126e-313d-44b0-855a-2372f6d532ee tempest-TestServerVolumeAttachmentScenario-547594335 None] Terminate volume connection completed successfully.
Aug 26 03:18:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-629f64ad-46b0-4a21-8897-3b2b9714522a req-3282126e-313d-44b0-855a-2372f6d532ee tempest-TestServerVolumeAttachmentScenario-547594335 None] Deleting attachment e3fe88a8-3c90-4ad8-93fd-df12c1d4b70a. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:18:40 devstack sudo[109744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e 1073741824
Aug 26 03:18:40 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:41 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.281s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5ad753e5-a690-4d7b-8e93-3a9c84ac0df9 tempest-VolumesGetTest-1066934511 None] Lock "cinder-f9bfe61c-5e20-4c96-bb2e-79cc223e9ae8-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:41 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e 1073741824" returned: 0 in 0.553s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:41 devstack sudo[109751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e
Aug 26 03:18:41 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:41 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e" returned: 0 in 0.240s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.486s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f6c6d8-a831-4882-a263-247eef89c921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f931c3b-622c-4bdb-a840-2f6c8337aa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Creating offline snapshot 90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f of volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a4d0d-b5a8-482d-9f82-ba859eea695f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Volume volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e (5ff8139d-13b0-4c2a-9b45-29045bb0da2e): created successfully
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f931c3b-622c-4bdb-a840-2f6c8337aa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (9390d895-0662-43c3-ab57-6900cc23f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a75363df-f58d-482c-84cb-e08b0e3d2e26 tempest-ProjectReaderTests-301140939 None] Created volume successfully.
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-6bf9ec04-8ebb-4257-8788-603528ab117d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Lock "cinder-6bf9ec04-8ebb-4257-8788-603528ab117d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:41 devstack sudo[109754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:41 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-6bf9ec04-8ebb-4257-8788-603528ab117d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-6bf9ec04-8ebb-4257-8788-603528ab117d" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[136433d3-1651-4799-aaf2-b9e8b7b250ba]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:42 devstack sudo[109756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d
Aug 26 03:18:42 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:42 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.481s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-ec4ee16e-4829-418e-aa17-f2e44e0ae17e req-984705f1-6a9b-4d69-b546-4875bdea527c tempest-TestServerVolumeAttachmentScenario-547594335 None] Terminate volume connection completed successfully.
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-ec4ee16e-4829-418e-aa17-f2e44e0ae17e req-984705f1-6a9b-4d69-b546-4875bdea527c tempest-TestServerVolumeAttachmentScenario-547594335 None] Deleting attachment e402c0e5-6c0d-4876-a1df-e0d14b2f4302. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:18:42 devstack sudo[109791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f 1G
Aug 26 03:18:42 devstack sudo[109791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:42 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d" returned: 0 in 0.394s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:42 devstack sudo[109797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d
Aug 26 03:18:42 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:42 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6bf9ec04-8ebb-4257-8788-603528ab117d" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-6bf9ec04-8ebb-4257-8788-603528ab117d" released by "delete_volume" :: held 0.714s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Created reservations ['ffcf8eaf-0470-477f-be6d-bf400854e99e', 'f47df1d7-29ca-4263-9b17-2de25c2223dd', 'bef85d7c-bfdf-40fd-a11a-b1e3ca118a5e', '7a8f0b58-807c-4b0a-8b52-2c1e28a784de'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:42 devstack sudo[109791]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f 1G" returned: 0 in 0.469s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:42 devstack sudo[109804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f
Aug 26 03:18:42 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-5ff8139d-13b0-4c2a-9b45-29045bb0da2e-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Lock "cinder-5ff8139d-13b0-4c2a-9b45-29045bb0da2e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:42 devstack sudo[109806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:42 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-quobyte-5ff8139d-13b0-4c2a-9b45-29045bb0da2e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-5ff8139d-13b0-4c2a-9b45-29045bb0da2e" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c0a550-6d44-4f41-bee8-1071beacb7b3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:43 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.357s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8e727057-ece9-484a-8358-bcc00b47029d tempest-VolumesGetTest-1066934511 None] Lock "cinder-6bf9ec04-8ebb-4257-8788-603528ab117d-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:43 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" returned: 0 in 0.539s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:43 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f is being set with open permissions: ugo+rw
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:43 devstack sudo[109824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e
Aug 26 03:18:43 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:43 devstack sudo[109847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f
Aug 26 03:18:43 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (c0271089-9561-494f-a1e2-b40d68689a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea8720b-27a6-41ba-9031-bd50a294e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea8720b-27a6-41ba-9031-bd50a294e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1617904220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9175ea1-36ec-48a4-ba5c-9b62cfb44353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:44Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:43 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f556e7-6dc4-4a49-9539-0acaeb4aa99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:43 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f556e7-6dc4-4a49-9539-0acaeb4aa99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6b272d-3aef-4dbe-acbb-9b13c8591e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6b272d-3aef-4dbe-acbb-9b13c8591e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'volume_name': 'volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef70609-4903-4a13-857d-e29f73725717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef70609-4903-4a13-857d-e29f73725717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152f0357-bfbe-4402-8c61-1cec0348f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:43 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Volume d9175ea1-36ec-48a4-ba5c-9b62cfb44353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'volume_size': 1}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" returned: 0 in 0.595s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e" returned: 0 in 0.846s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:43 devstack sudo[109863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e
Aug 26 03:18:43 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.079s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1617904220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9175ea1-36ec-48a4-ba5c-9b62cfb44353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:44Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Creating volume d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:44 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f578230e-ed02-4ce8-822f-a175c4d1be95 tempest-VolumesSnapshotListTestJSON-107469850 None] Create snapshot completed successfully
Aug 26 03:18:44 devstack sudo[109871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 1073741824
Aug 26 03:18:44 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:44 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ff8139d-13b0-4c2a-9b45-29045bb0da2e" returned: 0 in 0.349s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-5ff8139d-13b0-4c2a-9b45-29045bb0da2e" released by "delete_volume" :: held 1.277s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Created reservations ['927f5d1b-a37a-4a7c-9261-3c70ac41f9a0', '781ceb7f-0fbe-43ff-9d60-9fa7b2f1bea9', '8f4296fe-35cd-46ac-be32-f727fd536934', '22de8310-6d2b-43a8-860a-ada28c67846b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:44 devstack sudo[109887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:44 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:44 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 1073741824" returned: 0 in 0.799s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:44 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.366s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Deleted volume successfully.
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ed7ba25-aafd-4c1f-a5fa-e7e96a389eb8 tempest-ProjectReaderTests-301140939 None] Lock "cinder-5ff8139d-13b0-4c2a-9b45-29045bb0da2e-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:44 devstack sudo[109890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353
Aug 26 03:18:44 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:45 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" returned: 0 in 0.562s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152f0357-bfbe-4402-8c61-1cec0348f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf672ccf-4a2b-441d-9a54-ee5efc766313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Volume volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 (d9175ea1-36ec-48a4-ba5c-9b62cfb44353): created successfully
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf672ccf-4a2b-441d-9a54-ee5efc766313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (c0271089-9561-494f-a1e2-b40d68689a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-08e405ff-f543-4dae-8295-9fba9e34de8a tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Deleting offline snapshot 90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f of volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] snapshot_file for this snap is: volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[845d61ce-87a3-4001-976c-3e12303715c6]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:45 devstack sudo[109895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f
Aug 26 03:18:45 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (aa9c408b-ea0d-446f-b77d-dc748ba5b809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a095fc04-9548-4ea7-8457-ac8d4be0f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a095fc04-9548-4ea7-8457-ac8d4be0f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836813361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca0227c-3627-4e99-9d8b-6800cac03863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fdb1aa-db1f-4441-9f3a-dde9214e445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fdb1aa-db1f-4441-9f3a-dde9214e445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432267c5-15ef-43d4-9ad6-35e632879df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432267c5-15ef-43d4-9ad6-35e632879df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca0227c-3627-4e99-9d8b-6800cac03863', 'volume_name': 'volume-7ca0227c-3627-4e99-9d8b-6800cac03863', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b2ef5e-cef7-4e5f-8fe2-4a4c9cc94142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b2ef5e-cef7-4e5f-8fe2-4a4c9cc94142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c750a543-c1e5-428e-81da-d38842b92a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Volume 7ca0227c-3627-4e99-9d8b-6800cac03863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca0227c-3627-4e99-9d8b-6800cac03863', 'volume_size': 1}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836813361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca0227c-3627-4e99-9d8b-6800cac03863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Creating volume 7ca0227c-3627-4e99-9d8b-6800cac03863 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:46 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:46 devstack sudo[109900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863 1073741824
Aug 26 03:18:46 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:46 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" returned: 0 in 0.521s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d6b6e-753d-458b-8c10-b441e8b046be]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:46 devstack sudo[109903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:46 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:46 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.509s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:46 devstack sudo[109911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f
Aug 26 03:18:46 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:46 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863 1073741824" returned: 0 in 0.719s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:46 devstack sudo[109913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863
Aug 26 03:18:46 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (0754b783-7590-4190-8d69-c5012f8bb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf07acca-0484-4d1b-a19d-acc8ef80ee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf07acca-0484-4d1b-a19d-acc8ef80ee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283104809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c55f6d-a214-4c5d-b50b-89d9c506a61c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d9175ea1-36ec-48a4-ba5c-9b62cfb44353,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:47Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f203de-0111-4cac-9327-634f3f223853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f203de-0111-4cac-9327-634f3f223853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6907f12-58ac-40ca-9c49-ac17de4979af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6907f12-58ac-40ca-9c49-ac17de4979af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e1c55f6d-a214-4c5d-b50b-89d9c506a61c', 'volume_name': 'volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c', 'volume_size': 1, 'source_volid': 'd9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'source_volstatus': 'available'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f532a77-8824-4f38-b2af-68142a03d353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f532a77-8824-4f38-b2af-68142a03d353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb5962a-6aed-41e5-9415-130fae17cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Volume e1c55f6d-a214-4c5d-b50b-89d9c506a61c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c', 'volume_size': 1, 'source_volid': 'd9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'source_volstatus': 'available'}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:47 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863" returned: 0 in 0.257s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.124s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:47 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Cloning volume d9175ea1-36ec-48a4-ba5c-9b62cfb44353 to volume e1c55f6d-a214-4c5d-b50b-89d9c506a61c
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c750a543-c1e5-428e-81da-d38842b92a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca0227c-3627-4e99-9d8b-6800cac03863', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf49a002-27de-43bf-9406-80b871df9dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:47 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" returned: 0 in 0.430s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:47 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Volume volume-7ca0227c-3627-4e99-9d8b-6800cac03863 (7ca0227c-3627-4e99-9d8b-6800cac03863): created successfully
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf49a002-27de-43bf-9406-80b871df9dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (aa9c408b-ea0d-446f-b77d-dc748ba5b809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:47 devstack sudo[109919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f
Aug 26 03:18:47 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Creating offline snapshot 3a542306-a4f6-40f5-bd62-0b148a6049e7 of volume d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:18:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e324c8b6-5f0a-44dd-8dca-8ba7573337c1 tempest-ProjectReaderTests-301140939 None] Created volume successfully.
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ca9042-2364-45b6-8b08-18bbd723c8aa]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:47 devstack sudo[109921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353
Aug 26 03:18:47 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:47 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" returned: 0 in 0.279s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f" released by "_delete_snapshot" :: held 1.864s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" released by "delete_snapshot" :: held 1.891s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Created reservations ['7bdd5719-a3bc-4edb-aa88-8193cfd30f87', '0fe3f939-d95f-4671-b138-deac3004c1c1', 'bc5b980a-fba3-4445-aa64-5c3d700fce9c', '925be5f9-d155-49a7-b4c7-83f973d5e2af'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:47 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Delete snapshot completed successfully.
Aug 26 03:18:47 devstack sudo[109927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 1G
Aug 26 03:18:47 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e10c8ad6-5bf2-45f4-9e6d-8b1788381e00 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-90a7b7f5-116e-4dc1-b1ad-8bc0d5a2bb7f-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-852a1a49-d203-4631-9e27-3847ef0bd36b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-852a1a49-d203-4631-9e27-3847ef0bd36b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-852a1a49-d203-4631-9e27-3847ef0bd36b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-852a1a49-d203-4631-9e27-3847ef0bd36b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Deleting offline snapshot 852a1a49-d203-4631-9e27-3847ef0bd36b of volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] snapshot_file for this snap is: volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f3a34-d53e-49bb-93de-a4ed24e90dbc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:47 devstack sudo[109933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:47 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 1G" returned: 0 in 0.502s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7
Aug 26 03:18:48 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-7ca0227c-3627-4e99-9d8b-6800cac03863-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Lock "cinder-7ca0227c-3627-4e99-9d8b-6800cac03863-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-quobyte-7ca0227c-3627-4e99-9d8b-6800cac03863" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-7ca0227c-3627-4e99-9d8b-6800cac03863" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f61f75c-7573-442f-83b3-1a91c8a0af06]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.497s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f53ea5-cc53-4fcc-ae72-c74e7cafac9c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7" returned: 0 in 0.389s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:48 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 is being set with open permissions: ugo+rw
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863
Aug 26 03:18:48 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack sudo[109946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7
Aug 26 03:18:48 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack sudo[109943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:48 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:48 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863" returned: 0 in 0.449s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7" returned: 0 in 0.333s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.424s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863
Aug 26 03:18:48 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack sudo[109966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:48 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:48 devstack sudo[109969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info
Aug 26 03:18:48 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "cinder-aed3bb16-7201-4c34-88ca-fe85e70bc25f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-aed3bb16-7201-4c34-88ca-fe85e70bc25f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "cinder-quobyte-aed3bb16-7201-4c34-88ca-fe85e70bc25f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-quobyte-aed3bb16-7201-4c34-88ca-fe85e70bc25f" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:49 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7ca0227c-3627-4e99-9d8b-6800cac03863" returned: 0 in 0.283s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c05fd8-0ec9-4d6b-8088-031f601dea8e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-7ca0227c-3627-4e99-9d8b-6800cac03863" released by "delete_volume" :: held 0.794s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Created reservations ['1674d879-fe9b-4e57-83ec-8ffa6cd1d4ec', '1971f0ef-2f5b-49bd-9e72-98ad4b8512bc', '06ab96f3-76de-4f4a-8de3-44545caf3d4e', '372086cb-dd26-4b88-8b89-8f165eadb5c0'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:49 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info" returned: 0 in 0.328s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info is being set with open permissions: ugo+rw
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:49 devstack sudo[109972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f
Aug 26 03:18:49 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:49 devstack sudo[109979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info
Aug 26 03:18:49 devstack sudo[109979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:49 devstack sudo[109982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:49 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:49 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.557s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:49 devstack sudo[109984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b
Aug 26 03:18:49 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:49 devstack sudo[109979]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.info" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:49 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f" returned: 0 in 0.512s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] snapshot: 3a542306-a4f6-40f5-bd62-0b148a6049e7, volume: e1c55f6d-a214-4c5d-b50b-89d9c506a61c,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:18:49 devstack sudo[109991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f
Aug 26 03:18:49 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:49 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.852a1a49-d203-4631-9e27-3847ef0bd36b" returned: 0 in 0.292s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b5e09-3414-4df2-9895-7ab69da2298c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-852a1a49-d203-4631-9e27-3847ef0bd36b" released by "_delete_snapshot" :: held 1.892s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:49 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" released by "delete_snapshot" :: held 1.926s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Deleted volume successfully.
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2184ec2a-68bb-451b-88ec-06bb2efac28d tempest-ProjectReaderTests-301140939 None] Lock "cinder-7ca0227c-3627-4e99-9d8b-6800cac03863-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:49 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Created reservations ['512b95f6-0636-47e4-98d7-f78ad1fbb994', 'd5bfacd0-216a-435e-a750-2a748e84be1d', 'cb4e1885-8476-4f7f-b27f-a571be347700', '3aafcb5d-f058-4add-a483-ea2de90c62bf'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:49 devstack sudo[109994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7
Aug 26 03:18:49 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Delete snapshot completed successfully.
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-b16f5efd-ebeb-45bb-b314-1ed69a75dc15 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-852a1a49-d203-4631-9e27-3847ef0bd36b-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:50 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-aed3bb16-7201-4c34-88ca-fe85e70bc25f" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-quobyte-aed3bb16-7201-4c34-88ca-fe85e70bc25f" released by "delete_volume" :: held 0.984s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Created reservations ['c3db0302-93fc-4f34-a262-1c3c58a89fe0', '48634d15-e81f-4ea8-8067-7868a47f8bf7', '1116ead5-3a8c-468c-bb55-c0bf82f08fc0', '6bffe3c6-800c-430d-b8b2-2eaa57e28174'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (25e5a1a5-cc6d-4945-a533-879957e89967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4caf8e-a0a5-4a9a-ae1b-ca3bc9c8eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:50 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4caf8e-a0a5-4a9a-ae1b-ca3bc9c8eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435385275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4317a76b-cce0-4dba-b80c-d8cd4df7e1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:50Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82a31d2-2a6d-4843-b8a6-ecea16b472e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82a31d2-2a6d-4843-b8a6-ecea16b472e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db7db2e-f7d6-44d1-bf19-79377e7fe536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db7db2e-f7d6-44d1-bf19-79377e7fe536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4317a76b-cce0-4dba-b80c-d8cd4df7e1f9', 'volume_name': 'volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000bab89-bc8b-4eec-9318-5a6fcc15dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000bab89-bc8b-4eec-9318-5a6fcc15dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d874b3ea-3b9a-4fdf-ba08-75945a6d7b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:50 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Volume 4317a76b-cce0-4dba-b80c-d8cd4df7e1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9', 'volume_size': 1}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7" returned: 0 in 0.572s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69725050-4139-4611-a857-2fb0ece8d60f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:50 devstack sudo[110000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:50 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:50 devstack sudo[110001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353
Aug 26 03:18:50 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:50 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.239s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Deleted volume successfully.
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-195b8a0f-c6fa-44ef-b071-cab408d2c4dc tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-aed3bb16-7201-4c34-88ca-fe85e70bc25f-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:50 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" returned: 0 in 0.359s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:18:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:50 devstack sudo[110008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c
Aug 26 03:18:50 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-b41a6fec-1a2f-4f26-a94d-71a29139bc41-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-b41a6fec-1a2f-4f26-a94d-71a29139bc41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-b41a6fec-1a2f-4f26-a94d-71a29139bc41" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-b41a6fec-1a2f-4f26-a94d-71a29139bc41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Deleting offline snapshot b41a6fec-1a2f-4f26-a94d-71a29139bc41 of volume ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] snapshot_file for this snap is: volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f3684c-914c-4a9f-8d5e-c127c3290a2b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "cinder-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "cinder-quobyte-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-quobyte-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:51 devstack sudo[110014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:51 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7aa488-57fa-4c84-bf7f-97e726364156]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:51 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.785s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea30b775-12f0-487c-b62c-c12c08dabe00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:51 devstack sudo[110022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1
Aug 26 03:18:51 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[665126db-fce2-4795-a6ee-ea2d76650f34]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:52 devstack sudo[110027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00
Aug 26 03:18:52 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:52 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1" returned: 0 in 1.125s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:52 devstack sudo[110032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1
Aug 26 03:18:52 devstack sudo[110032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:53 devstack sudo[110032]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1" returned: 0 in 0.536s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-quobyte-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1" released by "delete_volume" :: held 1.769s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Created reservations ['e286cb55-5def-4b01-aaba-928c469f7de7', '1865e415-2fcd-43c7-8ccd-0aea277e574c', 'e0760502-820a-4790-aa07-aea36a3fc965', '978c7226-6f29-4c06-8dbb-e2bd87c39f3e'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:53 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00" returned: 0 in 1.556s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:53 devstack sudo[110038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:53 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:53 devstack sudo[110040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:53 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:54 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.957s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:54 devstack sudo[110047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41
Aug 26 03:18:54 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:54 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.830s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:54 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Deleted volume successfully.
Aug 26 03:18:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-426499da-c8fb-4af2-9923-445db46dbc20 tempest-TestServerVolumeAttachmentScenario-547594335 None] Lock "cinder-a476e6d1-3bc3-40d7-a9a2-4e44a0c806d1-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:55 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00.b41a6fec-1a2f-4f26-a94d-71a29139bc41" returned: 0 in 0.848s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-b41a6fec-1a2f-4f26-a94d-71a29139bc41" released by "_delete_snapshot" :: held 4.400s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" released by "delete_snapshot" :: held 4.438s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:55 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Created reservations ['9e3f8835-6569-41d2-8d08-4b0b76185449', '6270b40a-eb4d-4852-8984-f5fe7d2ddad3', 'c0bb6946-c8b5-48a6-842d-e17aeaf4826f', 'e8b7760e-5e19-4e52-897a-88e2626514c3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Delete snapshot completed successfully.
Aug 26 03:18:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6831b003-483c-4f1f-a8a7-b4fc6d918e87 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-b41a6fec-1a2f-4f26-a94d-71a29139bc41-delete_snapshot" released by "delete_snapshot" :: held 4.816s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:56 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" returned: 0 in 5.354s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:18:56 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Converted 1024.00 MB image at 191.22 MB/s
Aug 26 03:18:56 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c is being set with open permissions: ugo+rw
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:56 devstack sudo[110051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c
Aug 26 03:18:56 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:56 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" returned: 0 in 0.245s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" released by "_copy_volume_from_snapshot" :: held 6.652s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-3a542306-a4f6-40f5-bd62-0b148a6049e7" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-3a542306-a4f6-40f5-bd62-0b148a6049e7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Deleting offline snapshot 3a542306-a4f6-40f5-bd62-0b148a6049e7 of volume d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] snapshot_file for this snap is: volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37900664-744e-4181-82ec-73ad74caed4a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:56 devstack sudo[110054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7
Aug 26 03:18:56 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-ea30b775-12f0-487c-b62c-c12c08dabe00-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-ea30b775-12f0-487c-b62c-c12c08dabe00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:56 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fd4a8d-1e86-4fd6-a1c8-06bf03c122a4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f9a8d-088c-494e-9e8f-e7c73cd6e7de]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:18:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:56 devstack sudo[110060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353
Aug 26 03:18:56 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:57 devstack sudo[110061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00
Aug 26 03:18:57 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:57 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00" returned: 0 in 0.395s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:57 devstack sudo[110069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00
Aug 26 03:18:57 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:57 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" returned: 0 in 0.589s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:57 devstack sudo[110072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7
Aug 26 03:18:57 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:57 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea30b775-12f0-487c-b62c-c12c08dabe00" returned: 0 in 0.258s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-quobyte-ea30b775-12f0-487c-b62c-c12c08dabe00" released by "delete_volume" :: held 0.725s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Created reservations ['0ef2a7e3-7581-4a79-a8b4-7c28de21d8e7', '1017092e-ca96-48e1-aa58-c232ba14f6a6', '1e4003c3-a81f-4722-a053-76d84d736065', '40ed5154-e5fd-49aa-8d69-36441b8ffbf8'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:57 devstack sudo[110078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:18:57 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:57 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7" returned: 0 in 0.532s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:57 devstack sudo[110080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7
Aug 26 03:18:57 devstack sudo[110080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:58 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.288s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:18:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Deleted volume successfully.
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-486b3fd9-d4fd-4aaf-9904-b82f865246c8 tempest-VolumesSnapshotListTestJSON-107469850 None] Lock "cinder-ea30b775-12f0-487c-b62c-c12c08dabe00-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:58 devstack sudo[110080]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353.3a542306-a4f6-40f5-bd62-0b148a6049e7" returned: 0 in 0.277s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-3a542306-a4f6-40f5-bd62-0b148a6049e7" released by "_delete_snapshot" :: held 1.930s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.153s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.020s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435385275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4317a76b-cce0-4dba-b80c-d8cd4df7e1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5af7bd8a85467087ac5b1de19d989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:50Z,use_quota=True,user_id='59438cb141b04ed68dee2d9ba1acfaa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Creating volume 4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:18:58 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:58 devstack sudo[110084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 1073741824
Aug 26 03:18:58 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb5962a-6aed-41e5-9415-130fae17cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c', 'volume_size': 1, 'source_volid': 'd9175ea1-36ec-48a4-ba5c-9b62cfb44353', 'source_volstatus': 'available'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988271ae-a8d4-442e-9929-0fe4bb0583bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:58 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Volume volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c (e1c55f6d-a214-4c5d-b50b-89d9c506a61c): created successfully
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988271ae-a8d4-442e-9929-0fe4bb0583bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (0754b783-7590-4190-8d69-c5012f8bb04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-387b0f88-ba92-4ac1-865d-ee492fe19ec2 tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:18:58 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 1073741824" returned: 0 in 0.552s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:18:58 devstack sudo[110092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9
Aug 26 03:18:58 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:18:59 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d874b3ea-3b9a-4fdf-ba08-75945a6d7b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce45b78-e489-4ea7-931c-28cdce7c44f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:18:59 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Volume volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 (4317a76b-cce0-4dba-b80c-d8cd4df7e1f9): created successfully
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce45b78-e489-4ea7-931c-28cdce7c44f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:18:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Flow 'volume_create_manager' (25e5a1a5-cc6d-4945-a533-879957e89967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:18:59 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ddc00cf9-fc5e-4940-ba91-a827452f613d tempest-ProjectReaderTests-301140939 None] Created volume successfully.
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (68e733c5-97f8-490d-a108-8314f134d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1241ae-3a31-4806-bae1-dcf2a397fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1241ae-3a31-4806-bae1-dcf2a397fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884379788',display_name='tempest-VolumesGetTest-Volume-718685872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd347940-f6f9-4d53-9cd9-d5ed12c1d064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:00Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3732dfd3-c359-4d06-a3a2-3614b3883afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3732dfd3-c359-4d06-a3a2-3614b3883afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded50814-622e-4b0b-b1ba-ad9e7cbad46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded50814-622e-4b0b-b1ba-ad9e7cbad46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd347940-f6f9-4d53-9cd9-d5ed12c1d064', 'volume_name': 'volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6697fabd-0331-4e98-bec5-01d34e7dc0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6697fabd-0331-4e98-bec5-01d34e7dc0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd6bc59-b06a-4a52-8aa3-4b9fcb5ceebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Volume fd347940-f6f9-4d53-9cd9-d5ed12c1d064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064', 'volume_size': 1}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884379788',display_name='tempest-VolumesGetTest-Volume-718685872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd347940-f6f9-4d53-9cd9-d5ed12c1d064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:00Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Creating volume fd347940-f6f9-4d53-9cd9-d5ed12c1d064 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:00 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:00 devstack sudo[110097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 1073741824
Aug 26 03:19:00 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Lock "cinder-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Acquiring lock "cinder-quobyte-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4437da-2e77-43e0-a47b-9cd8678762db]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:00 devstack sudo[110099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9
Aug 26 03:19:00 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:00 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9" returned: 0 in 0.447s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:01 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 1073741824" returned: 0 in 0.634s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:01 devstack sudo[110107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9
Aug 26 03:19:01 devstack sudo[110107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:01 devstack sudo[110109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064
Aug 26 03:19:01 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:01 devstack sudo[110107]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9" returned: 0 in 0.353s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Lock "cinder-quobyte-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9" released by "delete_volume" :: held 0.880s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:01 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064" returned: 0 in 0.446s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fd6bc59-b06a-4a52-8aa3-4b9fcb5ceebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af73400a-5a71-41a5-bd84-8bfaae9f826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Created reservations ['13b8b1c0-d1d6-490d-8ccc-890cc0f25cfd', '998bc1ee-ec97-4a88-9cc6-409af7d5740f', '90c08479-f52e-497d-83b4-4a76ca18750e', '146c142f-15d7-4fdb-a2d0-d2673ea25cbe'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:01 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Volume volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 (fd347940-f6f9-4d53-9cd9-d5ed12c1d064): created successfully
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af73400a-5a71-41a5-bd84-8bfaae9f826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (68e733c5-97f8-490d-a108-8314f134d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9291ebce-9309-421f-a68e-9e426df7d32c tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:01 devstack sudo[110113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:01 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:01 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.310s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:01 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Deleted volume successfully.
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-10e2601b-ec03-4254-b744-b8a314dce68b tempest-ProjectReaderTests-301140939 None] Lock "cinder-4317a76b-cce0-4dba-b80c-d8cd4df7e1f9-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Flow 'volume_create_manager' (957c7471-dc57-4ea8-87eb-c5e8ef97989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6605f5-e581-49b3-ae20-0c0724b2bda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6605f5-e581-49b3-ae20-0c0724b2bda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1024134424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26368043-cf0e-4050-a501-b462add18519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ed9cf462494e37b4a7785139371ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:02Z,use_quota=True,user_id='5cd12197d8b748a89afe1860317537e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479591f1-d364-43e9-beb4-bfd7c54f154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479591f1-d364-43e9-beb4-bfd7c54f154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac70aaf9-3c61-4b92-8a04-9b70a7c88cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac70aaf9-3c61-4b92-8a04-9b70a7c88cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26368043-cf0e-4050-a501-b462add18519', 'volume_name': 'volume-26368043-cf0e-4050-a501-b462add18519', 'volume_size': 2}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620e9681-9e95-4f6e-97f9-b2aceab85264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620e9681-9e95-4f6e-97f9-b2aceab85264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed36380-2c57-4e0a-b106-88cb8db5f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:02 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Volume 26368043-cf0e-4050-a501-b462add18519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26368043-cf0e-4050-a501-b462add18519', 'volume_size': 2}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1024134424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26368043-cf0e-4050-a501-b462add18519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ed9cf462494e37b4a7785139371ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:02Z,use_quota=True,user_id='5cd12197d8b748a89afe1860317537e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Creating volume 26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:02 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 2147483648 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-fd347940-f6f9-4d53-9cd9-d5ed12c1d064-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-fd347940-f6f9-4d53-9cd9-d5ed12c1d064-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:02 devstack sudo[110117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 2147483648
Aug 26 03:19:02 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-fd347940-f6f9-4d53-9cd9-d5ed12c1d064" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-fd347940-f6f9-4d53-9cd9-d5ed12c1d064" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b95174-2638-4cc3-8863-61589708c18a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:02 devstack sudo[110119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064
Aug 26 03:19:02 devstack sudo[110119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:03 devstack sudo[110119]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:03 devstack sudo[110128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064
Aug 26 03:19:03 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:03 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 2147483648" returned: 0 in 0.663s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:03 devstack sudo[110130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519
Aug 26 03:19:03 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:03 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-fd347940-f6f9-4d53-9cd9-d5ed12c1d064" returned: 0 in 0.375s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-fd347940-f6f9-4d53-9cd9-d5ed12c1d064" released by "delete_volume" :: held 0.869s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Created reservations ['26665e6f-83e7-4e1a-87d0-31f0de8bac1c', '83a23782-5eee-45af-8557-f4ba706eb357', 'f096d205-5a47-4c37-aada-4478db93bf2a', '10323896-9d59-4dc4-9cf9-213fb77829e5'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:03 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519" returned: 0 in 0.335s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed36380-2c57-4e0a-b106-88cb8db5f259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26368043-cf0e-4050-a501-b462add18519', 'volume_size': 2}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af4ae4f-5727-4bb5-a062-dd13b4fdc371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:03 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Volume volume-26368043-cf0e-4050-a501-b462add18519 (26368043-cf0e-4050-a501-b462add18519): created successfully
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af4ae4f-5727-4bb5-a062-dd13b4fdc371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Flow 'volume_create_manager' (957c7471-dc57-4ea8-87eb-c5e8ef97989e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-cdc367d1-d54c-4efb-9607-38370153c2ce tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Created volume successfully.
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:03 devstack sudo[110134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:03 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:03 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.272s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:19:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-274a7382-9bc5-4950-bc6f-700317c75ac5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-fd347940-f6f9-4d53-9cd9-d5ed12c1d064-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Creating offline snapshot 6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 of volume 26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aef3a69-27b8-4084-9a92-2648b62bbcac]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:04 devstack sudo[110137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519
Aug 26 03:19:04 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-e1c55f6d-a214-4c5d-b50b-89d9c506a61c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-e1c55f6d-a214-4c5d-b50b-89d9c506a61c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b8994-c842-4695-b2f0-d80c28a4ab3a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:05 devstack sudo[110139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c
Aug 26 03:19:05 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:05 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519" returned: 0 in 0.546s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 2G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:05 devstack sudo[110144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 2G
Aug 26 03:19:05 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:05 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" returned: 0 in 0.407s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:05 devstack sudo[110151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c
Aug 26 03:19:05 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:05 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 2G" returned: 0 in 0.476s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26368043-cf0e-4050-a501-b462add18519 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:05 devstack sudo[110158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26368043-cf0e-4050-a501-b462add18519 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025
Aug 26 03:19:05 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:05 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" returned: 0 in 0.329s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-e1c55f6d-a214-4c5d-b50b-89d9c506a61c" released by "delete_volume" :: held 0.783s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Created reservations ['07f94ce5-9fba-4a76-89c0-581b777bebae', '3bfb6012-9dc7-443b-887f-3f0f5e17e868', 'a9c8300e-a43c-4e58-a099-410253b6c25a', 'ae5f25a7-b8a4-40d0-9022-3f2c3d63cb3a'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:05 devstack sudo[110161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:05 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:06 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26368043-cf0e-4050-a501-b462add18519 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" returned: 0 in 0.394s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:06 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 is being set with open permissions: ugo+rw
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:06 devstack sudo[110167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025
Aug 26 03:19:06 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-d9175ea1-36ec-48a4-ba5c-9b62cfb44353-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:06 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.299s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Lock "cinder-d9175ea1-36ec-48a4-ba5c-9b62cfb44353-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fb48c57c-607f-4f9d-be5a-bce91038e1e5 tempest-VolumesGetTest-1066934511 None] Lock "cinder-e1c55f6d-a214-4c5d-b50b-89d9c506a61c-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54732de2-5439-4352-91c9-e940d1e18638]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:06 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" returned: 0 in 0.336s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:06 devstack sudo[110172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info
Aug 26 03:19:06 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:06 devstack sudo[110171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353
Aug 26 03:19:06 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:06 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info" returned: 0 in 0.294s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:06 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info is being set with open permissions: ugo+rw
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:06 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" returned: 0 in 0.385s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:06 devstack sudo[110179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info
Aug 26 03:19:06 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:06 devstack sudo[110180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353
Aug 26 03:19:06 devstack sudo[110180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:07 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.info" returned: 0 in 0.263s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:07 devstack sudo[110180]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-d9175ea1-36ec-48a4-ba5c-9b62cfb44353" released by "delete_volume" :: held 0.779s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-47ed716e-76c5-444b-aa73-2ef2998699b3 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Create snapshot completed successfully
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Created reservations ['053478a6-41de-4ab3-92ea-df554bfced0b', 'f3e1cd46-6380-44dc-934b-49c3f5d7818d', 'fee3129e-9bc4-403d-80a9-9fcb993e3c2f', '54b7c269-3964-415c-9c37-2bc9da0995e2'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:07 devstack sudo[110185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:07 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:07 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:07 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-01bb18dd-5ccb-4933-8620-ce514337a50a tempest-VolumesGetTest-1066934511 None] Lock "cinder-d9175ea1-36ec-48a4-ba5c-9b62cfb44353-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "cinder-6a46eb3e-51d8-4e1d-b1a1-dea1cede0025-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-6a46eb3e-51d8-4e1d-b1a1-dea1cede0025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "cinder-quobyte-26368043-cf0e-4050-a501-b462add18519" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-quobyte-26368043-cf0e-4050-a501-b462add18519" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "cinder-quobyte-6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-quobyte-6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Deleting offline snapshot 6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 of volume 26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] snapshot_file for this snap is: volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453f419-e0b5-4f63-a1ed-d17b26e1905f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:08 devstack sudo[110188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025
Aug 26 03:19:08 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (f187d5b5-41ef-4624-9134-1b0202037d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fa816d-1a0e-4ba8-b831-59fd47d54499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fa816d-1a0e-4ba8-b831-59fd47d54499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1853956989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f1e720-409d-46d2-8847-50d55e8ada3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:08Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bf0b0d-42a4-411f-a92b-cbcc93ab2c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bf0b0d-42a4-411f-a92b-cbcc93ab2c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53de90a-38d8-4ad1-991b-4b7655ebaccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:19:08 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26368043-cf0e-4050-a501-b462add18519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4316132-4f20-4b36-9f40-969559f27f52]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:08 devstack sudo[110193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519
Aug 26 03:19:08 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:08 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519" returned: 0 in 0.413s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:08 devstack sudo[110199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025
Aug 26 03:19:08 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53de90a-38d8-4ad1-991b-4b7655ebaccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6f1e720-409d-46d2-8847-50d55e8ada3e', 'volume_name': 'volume-f6f1e720-409d-46d2-8847-50d55e8ada3e', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb293c20>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e544d97-221e-4228-abca-8ab72ad782e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e544d97-221e-4228-abca-8ab72ad782e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7af5ea-6e14-4ff9-b1a6-48d40d4e7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Volume f6f1e720-409d-46d2-8847-50d55e8ada3e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6f1e720-409d-46d2-8847-50d55e8ada3e', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb293c20>}
Aug 26 03:19:08 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Trying to clone f6f1e720-409d-46d2-8847-50d55e8ada3e from image fbacabb5-c169-4db6-835c-c8c852a95048 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:19:09 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae537bd-6f20-4783-8008-2e25b1ccd38a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:09 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:09 devstack sudo[110208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025
Aug 26 03:19:09 devstack sudo[110208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:09 devstack sudo[110207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD
Aug 26 03:19:09 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:09 devstack sudo[110208]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519.6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" returned: 0 in 0.255s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-quobyte-6a46eb3e-51d8-4e1d-b1a1-dea1cede0025" released by "_delete_snapshot" :: held 1.651s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-quobyte-26368043-cf0e-4050-a501-b462add18519" released by "delete_snapshot" :: held 1.687s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:09 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 is fetched for user 6ab5ff92ee04425d9c942dbed789f37f. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Created reservations ['d2afc023-4d16-4989-9cda-f35af66f8d31', '4483fa5c-7b3b-4247-96d0-047508760ba6', '3bcb0490-fd8f-4bf0-a1da-765005a8292d', '75683800-1a59-433e-96e8-4b679a34a422'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8adfd-28ae-4d0c-8d5d-ccd21353ab9f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Delete snapshot completed successfully.
Aug 26 03:19:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-930254a8-229a-4c2b-a41f-643890c36521 tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-6a46eb3e-51d8-4e1d-b1a1-dea1cede0025-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:09 devstack sudo[110215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD
Aug 26 03:19:09 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:10 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1853956989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f1e720-409d-46d2-8847-50d55e8ada3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:08Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Creating volume f6f1e720-409d-46d2-8847-50d55e8ada3e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:10 devstack sudo[110220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e 1073741824
Aug 26 03:19:10 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "cinder-26368043-cf0e-4050-a501-b462add18519-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-26368043-cf0e-4050-a501-b462add18519-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "cinder-quobyte-26368043-cf0e-4050-a501-b462add18519" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-quobyte-26368043-cf0e-4050-a501-b462add18519" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd97ce-2572-461c-9a07-05f83beeb594]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:10 devstack sudo[110222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519
Aug 26 03:19:10 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:10 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e 1073741824" returned: 0 in 0.546s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:10 devstack sudo[110230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e
Aug 26 03:19:10 devstack sudo[110230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:10 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519" returned: 0 in 0.446s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:10 devstack sudo[110233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519
Aug 26 03:19:10 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:10 devstack sudo[110230]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e" returned: 0 in 0.255s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Attempting download of fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume f6f1e720-409d-46d2-8847-50d55e8ada3e. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:19:10 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-26368043-cf0e-4050-a501-b462add18519" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-quobyte-26368043-cf0e-4050-a501-b462add18519" released by "delete_volume" :: held 0.789s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9487de50-3943-488e-a49f-efc6b456508c]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Created reservations ['6b508d79-6322-4d44-81b6-a77b1de8e1b1', 'e20c451c-0468-43fa-a2c1-cd6ea1161de1', '1e8454d9-1bfc-413f-ab90-f06d052a398e', '3045a4f2-5b08-4d6c-8ccd-f7543c08a9e7'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:11 devstack sudo[110237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4
Aug 26 03:19:11 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:11 devstack sudo[110239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:11 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:11 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:11 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.354s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Deleted volume successfully.
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-54f08432-c567-4094-a86b-84ac588ed77e tempest-VolumesSnapshotNegativeTestJSON-1483301049 None] Lock "cinder-26368043-cf0e-4050-a501-b462add18519-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:11 devstack sudo[110245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4
Aug 26 03:19:11 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:11 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4" returned: 1 in 0.410s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_gn2xumz4' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c047b6-7170-4c0a-af4c-a7c7e573eb86]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:11 devstack sudo[110249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD
Aug 26 03:19:11 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:12 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] fbacabb5-c169-4db6-835c-c8c852a95048 was qcow2, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:12 devstack sudo[110254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e
Aug 26 03:19:12 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:12 devstack sudo[110260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:12 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:12 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.361s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:19:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:19:14 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e" returned: 0 in 2.241s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_uq5z78hodevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:19:14 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Converted 112.00 MB image at 49.95 MB/s
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:14 devstack sudo[110267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e 1G
Aug 26 03:19:14 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:14 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e 1G" returned: 0 in 0.380s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Downloaded image fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume f6f1e720-409d-46d2-8847-50d55e8ada3e successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 for user 6ab5ff92ee04425d9c942dbed789f37f is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Marking volume f6f1e720-409d-46d2-8847-50d55e8ada3e as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Copying metadata from image fbacabb5-c169-4db6-835c-c8c852a95048 to f6f1e720-409d-46d2-8847-50d55e8ada3e. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Creating volume glance metadata for volume f6f1e720-409d-46d2-8847-50d55e8ada3e backed by image fbacabb5-c169-4db6-835c-c8c852a95048 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:19:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7af5ea-6e14-4ff9-b1a6-48d40d4e7f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f1e720-409d-46d2-8847-50d55e8ada3e', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb293c20>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cd64df-39ff-4467-a223-c2c9d8bea9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:15 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Volume volume-f6f1e720-409d-46d2-8847-50d55e8ada3e (f6f1e720-409d-46d2-8847-50d55e8ada3e): created successfully
Aug 26 03:19:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cd64df-39ff-4467-a223-c2c9d8bea9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (f187d5b5-41ef-4624-9134-1b0202037d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d7017917-c443-473f-87cd-39af9687d39d tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (50f2e554-1264-4734-92ae-af1917652e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d79e40-fac5-4e65-a695-f94b3bdbbf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d79e40-fac5-4e65-a695-f94b3bdbbf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1127547397',display_name='tempest-VolumesGetTest-Volume-192436830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94c3c20-480b-48c4-8e35-07775bb22c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:17Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8769b55-97a9-40f1-9fbc-20f38f7d80c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8769b55-97a9-40f1-9fbc-20f38f7d80c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bb7b63-eadf-40a5-9e7c-a8e33850075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bb7b63-eadf-40a5-9e7c-a8e33850075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94c3c20-480b-48c4-8e35-07775bb22c63', 'volume_name': 'volume-c94c3c20-480b-48c4-8e35-07775bb22c63', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77336da-09ae-4923-8115-996b8a5b3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77336da-09ae-4923-8115-996b8a5b3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e52e45-40a8-4c46-9eaa-9e3e7eaa1b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Volume c94c3c20-480b-48c4-8e35-07775bb22c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94c3c20-480b-48c4-8e35-07775bb22c63', 'volume_size': 1}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1127547397',display_name='tempest-VolumesGetTest-Volume-192436830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94c3c20-480b-48c4-8e35-07775bb22c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c35f914fc354ffab14ed0b986202d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:17Z,use_quota=True,user_id='6ab5ff92ee04425d9c942dbed789f37f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Creating volume c94c3c20-480b-48c4-8e35-07775bb22c63 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:16 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:16 devstack sudo[110274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63 1073741824
Aug 26 03:19:16 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:17 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63 1073741824" returned: 0 in 0.536s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:17 devstack sudo[110280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63
Aug 26 03:19:17 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:17 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63" returned: 0 in 0.291s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e52e45-40a8-4c46-9eaa-9e3e7eaa1b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94c3c20-480b-48c4-8e35-07775bb22c63', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22eb006-8876-4ec5-95a4-d35b500d02f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:17 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Volume volume-c94c3c20-480b-48c4-8e35-07775bb22c63 (c94c3c20-480b-48c4-8e35-07775bb22c63): created successfully
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22eb006-8876-4ec5-95a4-d35b500d02f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:17 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Flow 'volume_create_manager' (50f2e554-1264-4734-92ae-af1917652e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c7fca1e7-c9a8-436d-ba5a-6795ae922974 tempest-VolumesGetTest-1066934511 None] Created volume successfully.
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-c94c3c20-480b-48c4-8e35-07775bb22c63-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Lock "cinder-c94c3c20-480b-48c4-8e35-07775bb22c63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-c94c3c20-480b-48c4-8e35-07775bb22c63" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-c94c3c20-480b-48c4-8e35-07775bb22c63" acquired by "delete_volume" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd15be9-192f-4406-88f0-74fd5cccdc37]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:19 devstack sudo[110284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63
Aug 26 03:19:19 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:19 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63" returned: 0 in 0.444s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:19 devstack sudo[110289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63
Aug 26 03:19:19 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:19 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c94c3c20-480b-48c4-8e35-07775bb22c63" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-c94c3c20-480b-48c4-8e35-07775bb22c63" released by "delete_volume" :: held 0.776s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Created reservations ['dce69ac5-93ea-43ba-a96f-f3c4f9c8d4d5', '28772837-1559-43cb-b43f-5384e238c7f7', '3882dd42-dded-4917-9d95-25ac6f1d7a97', 'cbc90f91-88f8-404b-ab91-307b1e34117e'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:20 devstack sudo[110292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:20 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:20 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-f6f1e720-409d-46d2-8847-50d55e8ada3e-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.332s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Lock "cinder-f6f1e720-409d-46d2-8847-50d55e8ada3e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=167,cinder:UPDATE=212,cinder:INSERT=55,cinder:DELETE=13 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3169c3f1-faf4-4cb1-8b7b-f6fcdf253f0c tempest-VolumesGetTest-1066934511 None] Lock "cinder-c94c3c20-480b-48c4-8e35-07775bb22c63-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Acquiring lock "cinder-quobyte-f6f1e720-409d-46d2-8847-50d55e8ada3e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-f6f1e720-409d-46d2-8847-50d55e8ada3e" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6684852-9315-4bbd-b516-24c19ac72089]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:20 devstack sudo[110295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e
Aug 26 03:19:20 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:20 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e" returned: 0 in 0.400s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:20 devstack sudo[110300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e
Aug 26 03:19:20 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:21 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6f1e720-409d-46d2-8847-50d55e8ada3e" returned: 0 in 0.273s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Lock "cinder-quobyte-f6f1e720-409d-46d2-8847-50d55e8ada3e" released by "delete_volume" :: held 0.730s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Created reservations ['aa2dae18-daea-46f4-b8a1-5be4f6c85409', '7b41706f-c1d3-4a66-86c4-5e966214c1f3', 'ddc30048-bc56-4dfc-8bf0-53b7fe78b08c', '542a9e00-3cdc-424f-82d3-f07705f8c8c4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:21 devstack sudo[110303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:21 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:21 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.331s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Deleted volume successfully.
Aug 26 03:19:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-305f7eb6-a2fb-4ca1-9fc6-b88bdb121fd7 tempest-VolumesGetTest-1066934511 None] Lock "cinder-f6f1e720-409d-46d2-8847-50d55e8ada3e-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Flow 'volume_create_manager' (cf8a59c2-4a56-4e37-9111-d0b44a7be5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c42bee-298a-4dd4-923f-a74b62058162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c42bee-298a-4dd4-923f-a74b62058162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1096499084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b277ba-1f0f-41d6-b669-c761dcbbdb26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631c693c2ea44ac29e852c2efbe699bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:28Z,use_quota=True,user_id='912e4fe128aa4e26bffd555c5c2b1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554589bf-dda9-4366-9fdb-a093fd1ea6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554589bf-dda9-4366-9fdb-a093fd1ea6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce3bcb3-9b53-42bf-a234-fc9fe8c485ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce3bcb3-9b53-42bf-a234-fc9fe8c485ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b277ba-1f0f-41d6-b669-c761dcbbdb26', 'volume_name': 'volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cdc48d-9783-4b1b-b5f2-3a61cd236193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cdc48d-9783-4b1b-b5f2-3a61cd236193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0945ca8-d756-4dd0-8d03-15f8d87ff07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Volume 33b277ba-1f0f-41d6-b669-c761dcbbdb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26', 'volume_size': 1}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1096499084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b277ba-1f0f-41d6-b669-c761dcbbdb26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631c693c2ea44ac29e852c2efbe699bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:28Z,use_quota=True,user_id='912e4fe128aa4e26bffd555c5c2b1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Creating volume 33b277ba-1f0f-41d6-b669-c761dcbbdb26 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:28 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:28 devstack sudo[110307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 1073741824
Aug 26 03:19:28 devstack sudo[110307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:29 devstack sudo[110307]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 1073741824" returned: 0 in 0.562s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:29 devstack sudo[110314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26
Aug 26 03:19:29 devstack sudo[110314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:29 devstack sudo[110314]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26" returned: 0 in 0.283s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0945ca8-d756-4dd0-8d03-15f8d87ff07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2167469-2b55-4211-8366-e455784cb394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:29 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Volume volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 (33b277ba-1f0f-41d6-b669-c761dcbbdb26): created successfully
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2167469-2b55-4211-8366-e455784cb394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Flow 'volume_create_manager' (cf8a59c2-4a56-4e37-9111-d0b44a7be5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fc14c0de-f0d1-4509-be4b-14186999a4b1 tempest-VolumesListTestJSON-1261810397 None] Created volume successfully.
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Flow 'volume_create_manager' (c98cc651-12e0-4ada-bcb0-76c0f00696b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ce241-071b-4d2d-a8f1-1e1373fffeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ce241-071b-4d2d-a8f1-1e1373fffeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296457600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706bb9bd-2cbd-4ff2-bd86-f68d2305c106,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631c693c2ea44ac29e852c2efbe699bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:31Z,use_quota=True,user_id='912e4fe128aa4e26bffd555c5c2b1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0903ce9-e1f6-4b65-9b8b-2a24e872af74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0903ce9-e1f6-4b65-9b8b-2a24e872af74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc578e5b-32b1-4477-add6-a2e76ebec004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc578e5b-32b1-4477-add6-a2e76ebec004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706bb9bd-2cbd-4ff2-bd86-f68d2305c106', 'volume_name': 'volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2cde33-9e95-4e56-9855-dce16bd4d1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2cde33-9e95-4e56-9855-dce16bd4d1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f2a48b-7ab3-49c3-9f4d-57d874fb4687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Volume 706bb9bd-2cbd-4ff2-bd86-f68d2305c106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106', 'volume_size': 1}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296457600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706bb9bd-2cbd-4ff2-bd86-f68d2305c106,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631c693c2ea44ac29e852c2efbe699bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:31Z,use_quota=True,user_id='912e4fe128aa4e26bffd555c5c2b1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Creating volume 706bb9bd-2cbd-4ff2-bd86-f68d2305c106 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:31 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:31 devstack sudo[110317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 1073741824
Aug 26 03:19:31 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:31 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 1073741824" returned: 0 in 0.522s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:31 devstack sudo[110323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106
Aug 26 03:19:31 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:32 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106" returned: 0 in 0.295s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f2a48b-7ab3-49c3-9f4d-57d874fb4687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ab4c4b-3859-43e3-84b1-617ffbf65202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Volume volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 (706bb9bd-2cbd-4ff2-bd86-f68d2305c106): created successfully
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ab4c4b-3859-43e3-84b1-617ffbf65202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Flow 'volume_create_manager' (c98cc651-12e0-4ada-bcb0-76c0f00696b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9fb7069d-563b-4775-8add-cb92cbb635cb tempest-VolumesListTestJSON-1261810397 None] Created volume successfully.
Aug 26 03:19:33 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Flow 'volume_create_manager' (301d28a4-8b62-41d8-b086-b9671adf8081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669ce7cf-bdfb-48a1-8f12-5d8a3a11d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669ce7cf-bdfb-48a1-8f12-5d8a3a11d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1353688868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e0c7c3-f35f-4051-88f7-8cff8d2eb620,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631c693c2ea44ac29e852c2efbe699bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:34Z,use_quota=True,user_id='912e4fe128aa4e26bffd555c5c2b1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54c9b32-0118-4958-931f-c02d5707a0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54c9b32-0118-4958-931f-c02d5707a0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51185dbe-8900-4f9b-be98-6cc98c74194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51185dbe-8900-4f9b-be98-6cc98c74194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e0c7c3-f35f-4051-88f7-8cff8d2eb620', 'volume_name': 'volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db85f5d2-7548-4d12-bef8-f85eb2e5d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db85f5d2-7548-4d12-bef8-f85eb2e5d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287e74b9-8832-4c41-abb9-1304904da309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:34 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Volume e2e0c7c3-f35f-4051-88f7-8cff8d2eb620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620', 'volume_size': 1}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1353688868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e0c7c3-f35f-4051-88f7-8cff8d2eb620,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631c693c2ea44ac29e852c2efbe699bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:34Z,use_quota=True,user_id='912e4fe128aa4e26bffd555c5c2b1e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Creating volume e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:34 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:34 devstack sudo[110326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 1073741824
Aug 26 03:19:34 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:34 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 1073741824" returned: 0 in 0.561s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:34 devstack sudo[110332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620
Aug 26 03:19:34 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:34 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620" returned: 0 in 0.303s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287e74b9-8832-4c41-abb9-1304904da309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6b443f-b305-419b-842a-efb4c6ba9b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:35 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Volume volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 (e2e0c7c3-f35f-4051-88f7-8cff8d2eb620): created successfully
Aug 26 03:19:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6b443f-b305-419b-842a-efb4c6ba9b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Flow 'volume_create_manager' (301d28a4-8b62-41d8-b086-b9671adf8081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-cadae714-3bc7-4f07-8327-43e88aa69e96 tempest-VolumesListTestJSON-1261810397 None] Created volume successfully.
Aug 26 03:19:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "cinder-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "cinder-quobyte-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-quobyte-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa02285-4a05-4052-8c33-28379987d8c4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:38 devstack sudo[110335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620
Aug 26 03:19:38 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:39 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620" returned: 0 in 0.562s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:39 devstack sudo[110341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620
Aug 26 03:19:39 devstack sudo[110341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:39 devstack sudo[110341]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620" returned: 0 in 0.337s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-quobyte-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620" released by "delete_volume" :: held 0.964s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Created reservations ['01d7325b-76e8-4781-83ba-401ff8405d48', '1aeec643-3b35-43f4-9073-24b957ab64f0', 'c23aecd8-a1ca-4e5c-a03a-81e0d0f17a42', '4b1aadae-4ecb-46ce-8af8-1c20ae802bab'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:39 devstack sudo[110344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:39 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:39 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.290s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:39 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Deleted volume successfully.
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0245714b-5d95-4587-b051-2f1d4f44bf4e tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-e2e0c7c3-f35f-4051-88f7-8cff8d2eb620-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "cinder-706bb9bd-2cbd-4ff2-bd86-f68d2305c106-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-706bb9bd-2cbd-4ff2-bd86-f68d2305c106-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=139,cinder:UPDATE=179,cinder:INSERT=59,cinder:DELETE=17 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "cinder-quobyte-706bb9bd-2cbd-4ff2-bd86-f68d2305c106" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-quobyte-706bb9bd-2cbd-4ff2-bd86-f68d2305c106" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd3f11-f0d5-476d-ab7e-a3f22320681c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Flow 'volume_create_manager' (35a6e994-ca91-4739-b122-213ce6141cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4861100e-e4c5-4703-9b52-47ad2a92890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4861100e-e4c5-4703-9b52-47ad2a92890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-744558658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c858024-a3a2-46b9-9271-d61a13b93094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b1fcac8ff94150bc81213d5668fe09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:41Z,use_quota=True,user_id='cda8a85fa59a4415a76614aa7a38c11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b254dca3-aab0-43aa-8814-decabf6f34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b254dca3-aab0-43aa-8814-decabf6f34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:41 devstack sudo[110347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106
Aug 26 03:19:41 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b5a1bf-9f40-49a0-b2cb-a73306f7b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b5a1bf-9f40-49a0-b2cb-a73306f7b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c858024-a3a2-46b9-9271-d61a13b93094', 'volume_name': 'volume-7c858024-a3a2-46b9-9271-d61a13b93094', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb062a50>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597fe50d-ac96-42d3-9845-e19af3e357d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597fe50d-ac96-42d3-9845-e19af3e357d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a23b2ae-d37f-4bd3-9185-0d93374616da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Volume 7c858024-a3a2-46b9-9271-d61a13b93094: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c858024-a3a2-46b9-9271-d61a13b93094', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb062a50>}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Trying to clone 7c858024-a3a2-46b9-9271-d61a13b93094 from image fbacabb5-c169-4db6-835c-c8c852a95048 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:19:41 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106" returned: 0 in 0.444s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:41 devstack sudo[110352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106
Aug 26 03:19:41 devstack sudo[110352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:19:41 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Image download 20.69 MB at 20.69 MB/s
Aug 26 03:19:41 devstack sudo[110352]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-706bb9bd-2cbd-4ff2-bd86-f68d2305c106" returned: 0 in 0.339s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-quobyte-706bb9bd-2cbd-4ff2-bd86-f68d2305c106" released by "delete_volume" :: held 0.832s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f43580e-9142-43e8-9b30-0204b4bd2241]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Created reservations ['96315ca8-efac-4fae-b807-c59df6ae2544', '2af041ba-93a5-4c70-b659-a51c01f0dc4f', 'c6542cc4-c2b7-4076-9a7e-05af7388bd90', '55d7fc4b-45c0-4157-be11-08469cd3f5df'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:41 devstack sudo[110356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD
Aug 26 03:19:41 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:41 devstack sudo[110358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:41 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "cinder-33b277ba-1f0f-41d6-b669-c761dcbbdb26-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-33b277ba-1f0f-41d6-b669-c761dcbbdb26-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "cinder-quobyte-33b277ba-1f0f-41d6-b669-c761dcbbdb26" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-quobyte-33b277ba-1f0f-41d6-b669-c761dcbbdb26" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:19:42 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:42 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 is fetched for user cda8a85fa59a4415a76614aa7a38c11d. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:19:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Deleted volume successfully.
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8cc85c-22eb-439f-946e-f056800d5a88]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4b8a148b-b309-4f59-8e49-eca92cba6930 tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-706bb9bd-2cbd-4ff2-bd86-f68d2305c106-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9b125-cdf7-4ac6-8e59-e8ef9a91c763]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:42 devstack sudo[110364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26
Aug 26 03:19:42 devstack sudo[110364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:42 devstack sudo[110365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD
Aug 26 03:19:42 devstack sudo[110365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:42 devstack sudo[110364]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26" returned: 0 in 0.421s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:42 devstack sudo[110374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26
Aug 26 03:19:42 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:42 devstack sudo[110365]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-744558658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c858024-a3a2-46b9-9271-d61a13b93094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b1fcac8ff94150bc81213d5668fe09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:41Z,use_quota=True,user_id='cda8a85fa59a4415a76614aa7a38c11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Creating volume 7c858024-a3a2-46b9-9271-d61a13b93094 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:42 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:42 devstack sudo[110376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 1073741824
Aug 26 03:19:42 devstack sudo[110376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:42 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-33b277ba-1f0f-41d6-b669-c761dcbbdb26" returned: 0 in 0.269s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-quobyte-33b277ba-1f0f-41d6-b669-c761dcbbdb26" released by "delete_volume" :: held 0.756s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Created reservations ['6fbe526f-7047-4f11-b907-a86dfa6fb053', 'd4c6f73d-4be1-43b7-994b-5a6787e06e6f', '98c94775-509c-4303-ba03-9f18aaeafa25', 'c1650654-086a-4e7d-a60b-587b920ae7af'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:43 devstack sudo[110382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:19:43 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:43 devstack sudo[110376]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 1073741824" returned: 0 in 0.542s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:43 devstack sudo[110385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094
Aug 26 03:19:43 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:43 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.351s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:19:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Deleted volume successfully.
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e8279318-d388-4cae-9b56-7a960db154fa tempest-VolumesListTestJSON-1261810397 None] Lock "cinder-33b277ba-1f0f-41d6-b669-c761dcbbdb26-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:19:43 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094" returned: 0 in 0.330s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Attempting download of fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 7c858024-a3a2-46b9-9271-d61a13b93094. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56a787d-f9c6-4978-a15f-c92d17520636]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:43 devstack sudo[110389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85
Aug 26 03:19:43 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:44 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85" returned: 0 in 0.446s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:44 devstack sudo[110427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85
Aug 26 03:19:44 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:44 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85" returned: 1 in 0.414s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fbacabb5-c169-4db6-835c-c8c852a95048_43y1ha85' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:19:44 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[464dab6c-f210-4d5a-97c6-29c783d15049]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:19:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:44 devstack sudo[110436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD
Aug 26 03:19:44 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:45 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:45 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] fbacabb5-c169-4db6-835c-c8c852a95048 was qcow2, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:19:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:45 devstack sudo[110441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094
Aug 26 03:19:45 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:47 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094" returned: 0 in 2.627s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:47 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fbacabb5-c169-4db6-835c-c8c852a95048_bvn6l7bjdevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:19:47 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Converted 112.00 MB image at 42.61 MB/s
Aug 26 03:19:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:47 devstack sudo[110462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 1G
Aug 26 03:19:47 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:48 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 1G" returned: 0 in 0.473s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Downloaded image fbacabb5-c169-4db6-835c-c8c852a95048 ((None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}])) to volume 7c858024-a3a2-46b9-9271-d61a13b93094 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Temporary image fbacabb5-c169-4db6-835c-c8c852a95048 for user cda8a85fa59a4415a76614aa7a38c11d is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Marking volume 7c858024-a3a2-46b9-9271-d61a13b93094 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Copying metadata from image fbacabb5-c169-4db6-835c-c8c852a95048 to 7c858024-a3a2-46b9-9271-d61a13b93094. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Creating volume glance metadata for volume 7c858024-a3a2-46b9-9271-d61a13b93094 backed by image fbacabb5-c169-4db6-835c-c8c852a95048 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a23b2ae-d37f-4bd3-9185-0d93374616da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c858024-a3a2-46b9-9271-d61a13b93094', 'volume_size': 1, 'image_id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fbacabb5-c169-4db6-835c-c8c852a95048', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99784f1f68f140468c5565bf98444387', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fbacabb5-c169-4db6-835c-c8c852a95048', 'created_at': datetime.datetime(2026, 8, 26, 0, 59, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 59, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fbacabb5-c169-4db6-835c-c8c852a95048/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547fb062a50>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3b5da0-498b-4e80-9a7d-661910ef6d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:48 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Volume volume-7c858024-a3a2-46b9-9271-d61a13b93094 (7c858024-a3a2-46b9-9271-d61a13b93094): created successfully
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3b5da0-498b-4e80-9a7d-661910ef6d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Flow 'volume_create_manager' (35a6e994-ca91-4739-b122-213ce6141cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ddd0baac-838b-48ad-9d50-d02786ce70df tempest-TestShelveInstance-1281728214 None] Created volume successfully.
Aug 26 03:19:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-63ec17e7-814b-437d-9965-840e4df622cd req-84e4cd27-f3bc-4b0e-a6fe-9c3a93ef13ca tempest-TestShelveInstance-1281728214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-63ec17e7-814b-437d-9965-840e4df622cd req-84e4cd27-f3bc-4b0e-a6fe-9c3a93ef13ca tempest-TestShelveInstance-1281728214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-63ec17e7-814b-437d-9965-840e4df622cd req-84e4cd27-f3bc-4b0e-a6fe-9c3a93ef13ca tempest-TestShelveInstance-1281728214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-63ec17e7-814b-437d-9965-840e4df622cd req-84e4cd27-f3bc-4b0e-a6fe-9c3a93ef13ca tempest-TestShelveInstance-1281728214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-7c858024-a3a2-46b9-9271-d61a13b93094', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58312fd1-c6ce-4c33-8579-54dd4e585c2e', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:19:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-63ec17e7-814b-437d-9965-840e4df622cd req-84e4cd27-f3bc-4b0e-a6fe-9c3a93ef13ca tempest-TestShelveInstance-1281728214 None] attachment_update completed successfully.
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Flow 'volume_create_manager' (e7d79b23-d27f-43fd-8812-11764eac359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740dcf64-8537-41da-a200-d5bd418cc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740dcf64-8537-41da-a200-d5bd418cc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1520673707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105ee4bb-e4a0-45cf-8b1e-55846c8f9eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd869bfc966f428ba0a302b5d7acff5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:58Z,use_quota=True,user_id='04d46ce47037431da7cb7af7224bc1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34d9690-8d41-4d7a-9e75-c12417a725c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34d9690-8d41-4d7a-9e75-c12417a725c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ce0501-7a87-490a-a442-dbccc095e898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ce0501-7a87-490a-a442-dbccc095e898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105ee4bb-e4a0-45cf-8b1e-55846c8f9eba', 'volume_name': 'volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f642e0-2d95-4c3b-94ae-bc372fd64f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f642e0-2d95-4c3b-94ae-bc372fd64f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3feae03-c9df-4b6c-92fc-3698b1e3dc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:57 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Volume 105ee4bb-e4a0-45cf-8b1e-55846c8f9eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba', 'volume_size': 1}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1520673707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105ee4bb-e4a0-45cf-8b1e-55846c8f9eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd869bfc966f428ba0a302b5d7acff5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:58Z,use_quota=True,user_id='04d46ce47037431da7cb7af7224bc1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Creating volume 105ee4bb-e4a0-45cf-8b1e-55846c8f9eba {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:19:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:19:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:19:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:19:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:19:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:19:58 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:19:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:58 devstack sudo[111001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba 1073741824
Aug 26 03:19:58 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:59 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba 1073741824" returned: 0 in 1.049s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:19:59 devstack sudo[111036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba
Aug 26 03:19:59 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:19:59 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba" returned: 0 in 0.498s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3feae03-c9df-4b6c-92fc-3698b1e3dc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfa373c-416f-479f-8a19-dc9e4f83c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:19:59 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Volume volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba (105ee4bb-e4a0-45cf-8b1e-55846c8f9eba): created successfully
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfa373c-416f-479f-8a19-dc9e4f83c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:19:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Flow 'volume_create_manager' (e7d79b23-d27f-43fd-8812-11764eac359a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:19:59 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5f14bda9-9d39-4777-895a-25ae2056dff8 tempest-TestMinimumBasicScenario-1917133333 None] Created volume successfully.
Aug 26 03:20:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-86034826-b852-46eb-8584-9e86e890bebf req-b3e3741f-ef4c-40cb-b244-824c9eaa6478 tempest-TestMinimumBasicScenario-1917133333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-86034826-b852-46eb-8584-9e86e890bebf req-b3e3741f-ef4c-40cb-b244-824c9eaa6478 tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-86034826-b852-46eb-8584-9e86e890bebf req-b3e3741f-ef4c-40cb-b244-824c9eaa6478 tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-86034826-b852-46eb-8584-9e86e890bebf req-b3e3741f-ef4c-40cb-b244-824c9eaa6478 tempest-TestMinimumBasicScenario-1917133333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2a66dbc-58b5-455e-ad36-9811187cb6fb', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:20:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-86034826-b852-46eb-8584-9e86e890bebf req-b3e3741f-ef4c-40cb-b244-824c9eaa6478 tempest-TestMinimumBasicScenario-1917133333 None] attachment_update completed successfully.
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:12 devstack sudo[111143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:20:12 devstack sudo[111143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:13 devstack sudo[111143]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.446s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:INSERT=15,cinder:DELETE=3 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:20:13 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=62,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Flow 'volume_create_manager' (3898fefa-46bb-4b35-8096-80c5ff0ad61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ace741a-3008-4f21-b1b1-17366b6ea251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ace741a-3008-4f21-b1b1-17366b6ea251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-758291401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae0f53a-46c9-49ce-a366-47e849a93201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd64d7599c26481589c0cf7c3e3e86c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:19Z,use_quota=True,user_id='03cd08306fb145abb17aaa2470a2c567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a0e86a-ff40-4540-b030-f9d68123a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a0e86a-ff40-4540-b030-f9d68123a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43c168f-a522-4b9d-83a7-37e2ca4b2450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43c168f-a522-4b9d-83a7-37e2ca4b2450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae0f53a-46c9-49ce-a366-47e849a93201', 'volume_name': 'volume-5ae0f53a-46c9-49ce-a366-47e849a93201', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880e8eba-644f-4dfc-bec0-8527912fa92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880e8eba-644f-4dfc-bec0-8527912fa92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189e739f-40b5-42f4-bc60-8c6bd1c83b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:20:19 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Volume 5ae0f53a-46c9-49ce-a366-47e849a93201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae0f53a-46c9-49ce-a366-47e849a93201', 'volume_size': 1}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-758291401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae0f53a-46c9-49ce-a366-47e849a93201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd64d7599c26481589c0cf7c3e3e86c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:19Z,use_quota=True,user_id='03cd08306fb145abb17aaa2470a2c567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Creating volume 5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:20:19 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:19 devstack sudo[111175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 1073741824
Aug 26 03:20:19 devstack sudo[111175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:19 devstack sudo[111175]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 1073741824" returned: 0 in 0.494s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:19 devstack sudo[111191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201
Aug 26 03:20:19 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:20 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189e739f-40b5-42f4-bc60-8c6bd1c83b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae0f53a-46c9-49ce-a366-47e849a93201', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b8237c-c621-44f8-8e62-838eb74a5ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:20:20 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Volume volume-5ae0f53a-46c9-49ce-a366-47e849a93201 (5ae0f53a-46c9-49ce-a366-47e849a93201): created successfully
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b8237c-c621-44f8-8e62-838eb74a5ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:20:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Flow 'volume_create_manager' (3898fefa-46bb-4b35-8096-80c5ff0ad61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:20:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6c565cd1-37cc-4f8d-8d87-ee851678b3a5 tempest-TestImageHashVerification-1504417901 None] Created volume successfully.
Aug 26 03:20:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a91bc-71a3-4ed7-be66-ee2227e6d6af]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:22 devstack sudo[111197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201
Aug 26 03:20:22 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:22 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bae9bd9-6b96-45c0-839e-bd89dd194cbf]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:22 devstack sudo[111202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201
Aug 26 03:20:22 devstack sudo[111202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:22 devstack sudo[111202]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 /opt/stack/data/cinder/conversion/5ae0f53a-46c9-49ce-a366-47e849a93201.temp_image.c3f76e03-4f6f-4337-a10f-b96fde846dbflnwef1ol.img {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:22 devstack sudo[111207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 /opt/stack/data/cinder/conversion/5ae0f53a-46c9-49ce-a366-47e849a93201.temp_image.c3f76e03-4f6f-4337-a10f-b96fde846dbflnwef1ol.img
Aug 26 03:20:22 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:26 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 /opt/stack/data/cinder/conversion/5ae0f53a-46c9-49ce-a366-47e849a93201.temp_image.c3f76e03-4f6f-4337-a10f-b96fde846dbflnwef1ol.img" returned: 0 in 4.049s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f17236c-fa9e-45ac-9795-e833b65054ed]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:20:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:26 devstack sudo[111222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201
Aug 26 03:20:26 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:27 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201" returned: 0 in 0.533s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:27 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/conversion/5ae0f53a-46c9-49ce-a366-47e849a93201.temp_image.c3f76e03-4f6f-4337-a10f-b96fde846dbflnwef1ol.img {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:20:27 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Converted 1024.00 MB image at 252.80 MB/s
Aug 26 03:20:27 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] c3f76e03-4f6f-4337-a10f-b96fde846dbf was raw, no need to convert to raw {{(pid=94326) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 26 03:20:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-8573768a-e4c1-4964-b036-5c71f90f869d req-6615b499-04f5-4fab-ad34-2acb9b5cb11c tempest-TestShelveInstance-1281728214 None] Terminate volume connection completed successfully.
Aug 26 03:20:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-8573768a-e4c1-4964-b036-5c71f90f869d req-6615b499-04f5-4fab-ad34-2acb9b5cb11c tempest-TestShelveInstance-1281728214 None] Deleting attachment 58312fd1-c6ce-4c33-8579-54dd4e585c2e. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:20:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-5676f2d4-f3e6-4744-b0d6-d58fda8d5567 req-58ae8178-af29-4366-bfe2-019a11b15325 tempest-TestShelveInstance-1281728214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:44 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:20:48 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6,cinder:INSERT=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:20:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.452s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Uploaded volume to glance image-id: c3f76e03-4f6f-4337-a10f-b96fde846dbf. {{(pid=94326) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 26 03:20:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-5676f2d4-f3e6-4744-b0d6-d58fda8d5567 req-58ae8178-af29-4366-bfe2-019a11b15325 tempest-TestShelveInstance-1281728214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.644s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-5676f2d4-f3e6-4744-b0d6-d58fda8d5567 req-58ae8178-af29-4366-bfe2-019a11b15325 tempest-TestShelveInstance-1281728214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ad54d74d-79d6-47ff-89e9-67985d462179 tempest-TestImageHashVerification-1504417901 None] Copy volume to image completed successfully.
Aug 26 03:20:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-5676f2d4-f3e6-4744-b0d6-d58fda8d5567 req-58ae8178-af29-4366-bfe2-019a11b15325 tempest-TestShelveInstance-1281728214 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-7c858024-a3a2-46b9-9271-d61a13b93094', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89d36618-59c4-4ada-bd8b-326f4402a6ac', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:20:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-5676f2d4-f3e6-4744-b0d6-d58fda8d5567 req-58ae8178-af29-4366-bfe2-019a11b15325 tempest-TestShelveInstance-1281728214 None] attachment_update completed successfully.
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Acquiring lock "cinder-5ae0f53a-46c9-49ce-a366-47e849a93201-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Lock "cinder-5ae0f53a-46c9-49ce-a366-47e849a93201-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Acquiring lock "cinder-quobyte-5ae0f53a-46c9-49ce-a366-47e849a93201" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Lock "cinder-quobyte-5ae0f53a-46c9-49ce-a366-47e849a93201" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3158a2-ed59-4358-9992-6ca0200fd6dc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:52 devstack sudo[111839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201
Aug 26 03:20:52 devstack sudo[111839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:52 devstack sudo[111839]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:52 devstack sudo[111846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201
Aug 26 03:20:52 devstack sudo[111846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:52 devstack sudo[111846]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-5ae0f53a-46c9-49ce-a366-47e849a93201" returned: 0 in 0.248s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Lock "cinder-quobyte-5ae0f53a-46c9-49ce-a366-47e849a93201" released by "delete_volume" :: held 0.788s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Created reservations ['a4a009d3-bcc1-450a-aa05-4bd0314847d5', 'ba499498-5212-40cf-b547-2ebd8e75187c', 'ebc3af94-766e-4afc-9e36-7edb91882005', '3b476b64-e419-4d89-a683-975bd23db4cd'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:20:53 devstack sudo[111849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:20:53 devstack sudo[111849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:20:53 devstack sudo[111849]: pam_unix(sudo:session): session closed for user root
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.406s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:20:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Deleted volume successfully.
Aug 26 03:20:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-fef37306-0bfa-428f-acee-4c469bb31081 tempest-TestImageHashVerification-1504417901 None] Lock "cinder-5ae0f53a-46c9-49ce-a366-47e849a93201-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:03 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:21:03 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=11,cinder:SELECT=13,cinder:DELETE=1 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:21:04 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-971d05ad-516c-4b0d-b1d4-e3da3c076391 req-2cbce081-2b7f-4835-8de6-2c875d43f298 tempest-TestMinimumBasicScenario-1917133333 None] Terminate volume connection completed successfully.
Aug 26 03:21:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-971d05ad-516c-4b0d-b1d4-e3da3c076391 req-2cbce081-2b7f-4835-8de6-2c875d43f298 tempest-TestMinimumBasicScenario-1917133333 None] Deleting attachment c2a66dbc-58b5-455e-ad36-9811187cb6fb. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:21:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Acquiring lock "cinder-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Lock "cinder-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Acquiring lock "cinder-quobyte-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Lock "cinder-quobyte-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:05 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ca200-df2a-4916-b138-a7bc5364e3ca]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:05 devstack sudo[111987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba
Aug 26 03:21:05 devstack sudo[111987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:06 devstack sudo[111987]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba" returned: 0 in 0.386s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:06 devstack sudo[111992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba
Aug 26 03:21:06 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:06 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba" returned: 0 in 0.277s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Lock "cinder-quobyte-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba" released by "delete_volume" :: held 0.733s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Created reservations ['26289fd4-58f6-4ab1-9463-a7a374f158d1', 'ffdd28cf-e2d6-424e-8802-8723d4909d98', 'ac828f60-5ea0-40b1-b5b0-a1eb722d27da', '02331481-ac5c-4aba-a442-b284ccb39757'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:06 devstack sudo[111995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:06 devstack sudo[111995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:06 devstack sudo[111995]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.332s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Deleted volume successfully.
Aug 26 03:21:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-69033744-5e2a-48fb-a593-011a3ad0084c tempest-TestMinimumBasicScenario-1917133333 None] Lock "cinder-105ee4bb-e4a0-45cf-8b1e-55846c8f9eba-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (5f3fcbc7-7fe5-4d00-b19e-bb99ba6dafad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd0b26a-2fff-4f96-92ec-175f28c8f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd0b26a-2fff-4f96-92ec-175f28c8f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440255054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:09Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf23922d-71fb-4631-a284-9633633d8b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf23922d-71fb-4631-a284-9633633d8b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a340f977-4025-494e-adb0-f8a304a2ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a340f977-4025-494e-adb0-f8a304a2ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad', 'volume_name': 'volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02643021-434c-47c5-94d1-2d34a3ac531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02643021-434c-47c5-94d1-2d34a3ac531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e58c31-98ef-47ed-8a61-42cc217ed4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Volume 82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad', 'volume_size': 1}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440255054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:09Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Creating volume 82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:09 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:09 devstack sudo[112025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad 1073741824
Aug 26 03:21:09 devstack sudo[112025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (2d202759-aeeb-483c-b62e-c17e3625ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5c159e-ff6e-45b0-8294-ad24fb22e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5c159e-ff6e-45b0-8294-ad24fb22e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708425843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f6d396-1fb5-4058-923e-224871e8feaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:10Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da92b610-09de-4edf-b36f-d3194a5cc9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da92b610-09de-4edf-b36f-d3194a5cc9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8e3458-04c0-4877-af28-775e37079224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8e3458-04c0-4877-af28-775e37079224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f6d396-1fb5-4058-923e-224871e8feaf', 'volume_name': 'volume-b9f6d396-1fb5-4058-923e-224871e8feaf', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6fdc9b-63d9-4bf5-a358-cb6a01a8957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6fdc9b-63d9-4bf5-a358-cb6a01a8957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5fc0ed-bfdd-4315-8af9-56b33f599d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Volume b9f6d396-1fb5-4058-923e-224871e8feaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f6d396-1fb5-4058-923e-224871e8feaf', 'volume_size': 1}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:10 devstack sudo[112025]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad 1073741824" returned: 0 in 0.869s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:10 devstack sudo[112031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad
Aug 26 03:21:10 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (216225d1-ed9f-47b6-8214-54d0271187de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cdd1bd-9263-47d6-bc52-41a79b91ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cdd1bd-9263-47d6-bc52-41a79b91ce92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1090586748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94cba924-6f34-42d2-9c23-f24bb2ac0916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:10Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d867204-8233-44c7-8d75-d4fead1d3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d867204-8233-44c7-8d75-d4fead1d3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb2b943-68f4-4597-a378-947bfcf68d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb2b943-68f4-4597-a378-947bfcf68d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94cba924-6f34-42d2-9c23-f24bb2ac0916', 'volume_name': 'volume-94cba924-6f34-42d2-9c23-f24bb2ac0916', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddba4690-2d85-4e6d-bcce-694e02ba4a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddba4690-2d85-4e6d-bcce-694e02ba4a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9a3db0-55fc-44aa-993a-d2e6d812de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Volume 94cba924-6f34-42d2-9c23-f24bb2ac0916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94cba924-6f34-42d2-9c23-f24bb2ac0916', 'volume_size': 1}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708425843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f6d396-1fb5-4058-923e-224871e8feaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:10Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Creating volume b9f6d396-1fb5-4058-923e-224871e8feaf {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e58c31-98ef-47ed-8a61-42cc217ed4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack sudo[112034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf 1073741824
Aug 26 03:21:10 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c53e74-33c8-444f-b878-ae6b5835e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Volume volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad (82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad): created successfully
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c53e74-33c8-444f-b878-ae6b5835e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (5f3fcbc7-7fe5-4d00-b19e-bb99ba6dafad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-01a4b11a-8ef5-4f74-8739-7f221bfb839a tempest-CreateVolumesFromImageTest-140055433 None] Created volume successfully.
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (a7e941aa-265c-454d-aa94-49b6197f3475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c345fdce-c2b0-484f-a8de-e212c4abceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c345fdce-c2b0-484f-a8de-e212c4abceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195527855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822e4098-a8e9-4c66-a295-a1df2c6755b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:11Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41729fa-46b9-4331-abcb-4f4d21398a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41729fa-46b9-4331-abcb-4f4d21398a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68560e5-fc5c-42df-aeb9-6ddd993d926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68560e5-fc5c-42df-aeb9-6ddd993d926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822e4098-a8e9-4c66-a295-a1df2c6755b8', 'volume_name': 'volume-822e4098-a8e9-4c66-a295-a1df2c6755b8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48050b69-1307-489b-ba32-8db669770c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48050b69-1307-489b-ba32-8db669770c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f808c8-16c7-4394-a83b-c78eaefda114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Volume 822e4098-a8e9-4c66-a295-a1df2c6755b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822e4098-a8e9-4c66-a295-a1df2c6755b8', 'volume_size': 1}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:11 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf 1073741824" returned: 0 in 0.690s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:11 devstack sudo[112048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf
Aug 26 03:21:11 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (71666010-e06d-4e11-8269-5ac3e418fdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22760989-bcfd-4486-987e-95084391b155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22760989-bcfd-4486-987e-95084391b155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1360375033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c03f4e-e114-4a02-b705-cf9bec3ae438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:11Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86605e36-0503-46b0-a4d7-31bf3ac8fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86605e36-0503-46b0-a4d7-31bf3ac8fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46a2819-a316-4d84-8c9a-20b6ba7156b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46a2819-a316-4d84-8c9a-20b6ba7156b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c03f4e-e114-4a02-b705-cf9bec3ae438', 'volume_name': 'volume-12c03f4e-e114-4a02-b705-cf9bec3ae438', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e66108-7db9-4c68-be9b-3c5074fd7993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e66108-7db9-4c68-be9b-3c5074fd7993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3d6910-9f23-42c4-b947-1217baea8577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Volume 12c03f4e-e114-4a02-b705-cf9bec3ae438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c03f4e-e114-4a02-b705-cf9bec3ae438', 'volume_size': 1}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:11 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1090586748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94cba924-6f34-42d2-9c23-f24bb2ac0916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:10Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Creating volume 94cba924-6f34-42d2-9c23-f24bb2ac0916 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:11 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:11 devstack sudo[112051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 1073741824
Aug 26 03:21:11 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5fc0ed-bfdd-4315-8af9-56b33f599d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f6d396-1fb5-4058-923e-224871e8feaf', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ca036b-0e5a-4bf6-8738-8e14ad607198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Volume volume-b9f6d396-1fb5-4058-923e-224871e8feaf (b9f6d396-1fb5-4058-923e-224871e8feaf): created successfully
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ca036b-0e5a-4bf6-8738-8e14ad607198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (2d202759-aeeb-483c-b62e-c17e3625ab23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d648c025-74d1-43bf-9a5a-34de57d1925c tempest-CreateVolumesFromImageTest-140055433 None] Created volume successfully.
Aug 26 03:21:12 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 1073741824" returned: 0 in 0.486s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:12 devstack sudo[112057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916
Aug 26 03:21:12 devstack sudo[112057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:12 devstack sudo[112057]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195527855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822e4098-a8e9-4c66-a295-a1df2c6755b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:11Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Creating volume 822e4098-a8e9-4c66-a295-a1df2c6755b8 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:12 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:12 devstack sudo[112060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 1073741824
Aug 26 03:21:12 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9a3db0-55fc-44aa-993a-d2e6d812de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94cba924-6f34-42d2-9c23-f24bb2ac0916', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:12 devstack sudo[112062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:12 devstack sudo[112062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b55181-9c3c-4ae4-97dc-8a56eb560706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:12 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Volume volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 (94cba924-6f34-42d2-9c23-f24bb2ac0916): created successfully
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b55181-9c3c-4ae4-97dc-8a56eb560706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (216225d1-ed9f-47b6-8214-54d0271187de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-61523547-6b86-4380-8e98-778230317520 tempest-CreateVolumesFromImageTest-140055433 None] Created volume successfully.
Aug 26 03:21:12 devstack sudo[112062]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.311s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:21:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:21:13 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 1073741824" returned: 0 in 0.492s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:13 devstack sudo[112069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8
Aug 26 03:21:13 devstack sudo[112069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:13 devstack sudo[112069]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8" returned: 0 in 0.258s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1360375033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c03f4e-e114-4a02-b705-cf9bec3ae438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f6e08775564a778c735c642a2967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:11Z,use_quota=True,user_id='a29573eb750a4ff78608420533ad5466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Creating volume 12c03f4e-e114-4a02-b705-cf9bec3ae438 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:13 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f808c8-16c7-4394-a83b-c78eaefda114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822e4098-a8e9-4c66-a295-a1df2c6755b8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:13 devstack sudo[112072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 1073741824
Aug 26 03:21:13 devstack sudo[112072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6dcf7-7a31-4cda-9677-56ca6ef1e0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Volume volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 (822e4098-a8e9-4c66-a295-a1df2c6755b8): created successfully
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d6dcf7-7a31-4cda-9677-56ca6ef1e0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (a7e941aa-265c-454d-aa94-49b6197f3475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-373fa80e-9b6b-4a6a-abd5-8a69793ebcca tempest-CreateVolumesFromImageTest-140055433 None] Created volume successfully.
Aug 26 03:21:13 devstack sudo[112072]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 1073741824" returned: 0 in 0.476s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:13 devstack sudo[112078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438
Aug 26 03:21:13 devstack sudo[112078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:14 devstack sudo[112078]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438" returned: 0 in 0.260s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3d6910-9f23-42c4-b947-1217baea8577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c03f4e-e114-4a02-b705-cf9bec3ae438', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a3beec-09c5-440e-9c14-d997f08aca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Volume volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 (12c03f4e-e114-4a02-b705-cf9bec3ae438): created successfully
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a3beec-09c5-440e-9c14-d997f08aca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Flow 'volume_create_manager' (71666010-e06d-4e11-8269-5ac3e418fdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9889b450-7f01-4791-88da-3cdf3d64f37a tempest-CreateVolumesFromImageTest-140055433 None] Created volume successfully.
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-12c03f4e-e114-4a02-b705-cf9bec3ae438-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-12c03f4e-e114-4a02-b705-cf9bec3ae438-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-quobyte-12c03f4e-e114-4a02-b705-cf9bec3ae438" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-12c03f4e-e114-4a02-b705-cf9bec3ae438" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e9303c-a108-4c91-beec-698dcd523048]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:15 devstack sudo[112084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438
Aug 26 03:21:15 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:15 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438" returned: 0 in 0.474s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:15 devstack sudo[112089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438
Aug 26 03:21:15 devstack sudo[112089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:15 devstack sudo[112089]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-12c03f4e-e114-4a02-b705-cf9bec3ae438" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-12c03f4e-e114-4a02-b705-cf9bec3ae438" released by "delete_volume" :: held 0.773s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Created reservations ['474182c1-ff06-40ab-a1f4-9bddc816f94a', '5f2407ad-3f6d-4006-ba13-e562780004b7', '2fc0ad2b-f4d6-44e9-bd83-e8005c2d6320', '2b2c330d-4914-4b4d-9b57-bd0939388a01'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:15 devstack sudo[112092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:15 devstack sudo[112092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-822e4098-a8e9-4c66-a295-a1df2c6755b8-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-822e4098-a8e9-4c66-a295-a1df2c6755b8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:16 devstack sudo[112092]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-quobyte-822e4098-a8e9-4c66-a295-a1df2c6755b8" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Deleted volume successfully.
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-822e4098-a8e9-4c66-a295-a1df2c6755b8" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d8f8a457-47bd-4735-9695-4b21f848ca45 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-12c03f4e-e114-4a02-b705-cf9bec3ae438-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5298554e-f853-4205-9678-bff04ad4d88e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:16 devstack sudo[112096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8
Aug 26 03:21:16 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:16 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:16 devstack sudo[112101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8
Aug 26 03:21:16 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:16 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-822e4098-a8e9-4c66-a295-a1df2c6755b8" returned: 0 in 0.264s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-822e4098-a8e9-4c66-a295-a1df2c6755b8" released by "delete_volume" :: held 0.676s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:16 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Created reservations ['6ba19442-c30a-4a24-9d65-2fcdddc0f699', 'c2ff9e46-729a-49ca-9751-fe4029ae4ab4', '947117a2-1fc4-485a-b27d-b0fb75d5ca64', '19b5d900-63b8-4c26-a168-15dd7f44b9e2'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:17 devstack sudo[112104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:17 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:17 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.263s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-94cba924-6f34-42d2-9c23-f24bb2ac0916-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Deleted volume successfully.
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-94cba924-6f34-42d2-9c23-f24bb2ac0916-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e6a3c95a-7bb4-4032-ab74-95048c5f69f0 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-822e4098-a8e9-4c66-a295-a1df2c6755b8-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-quobyte-94cba924-6f34-42d2-9c23-f24bb2ac0916" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-94cba924-6f34-42d2-9c23-f24bb2ac0916" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[64525de3-0e89-4a5a-b4f2-5b9c8754a7df]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:17 devstack sudo[112107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916
Aug 26 03:21:17 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:17 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916" returned: 0 in 0.426s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:18 devstack sudo[112114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916
Aug 26 03:21:18 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:18 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-94cba924-6f34-42d2-9c23-f24bb2ac0916" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-94cba924-6f34-42d2-9c23-f24bb2ac0916" released by "delete_volume" :: held 0.791s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Created reservations ['ba4ca15c-8765-4695-92fe-b159a037b8b3', '5d3e7ba6-8de5-4016-9166-907d6d48a8ef', '18b33efc-39dc-4414-87ad-f4eb50280359', '7e571b2d-3e16-4bab-8add-98af55667d86'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:18 devstack sudo[112117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:18 devstack sudo[112117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-b9f6d396-1fb5-4058-923e-224871e8feaf-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-b9f6d396-1fb5-4058-923e-224871e8feaf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-quobyte-b9f6d396-1fb5-4058-923e-224871e8feaf" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-b9f6d396-1fb5-4058-923e-224871e8feaf" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192c367-e354-4004-8416-83dc301de48e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:18 devstack sudo[112117]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Deleted volume successfully.
Aug 26 03:21:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-921fe208-aebf-4694-be08-71f4b6edb1c2 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-94cba924-6f34-42d2-9c23-f24bb2ac0916-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:18 devstack sudo[112120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf
Aug 26 03:21:18 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:19 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf" returned: 0 in 0.437s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:19 devstack sudo[112125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf
Aug 26 03:21:19 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:19 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b9f6d396-1fb5-4058-923e-224871e8feaf" returned: 0 in 0.245s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-b9f6d396-1fb5-4058-923e-224871e8feaf" released by "delete_volume" :: held 0.741s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Created reservations ['acd7d1d2-bab0-44cb-a469-c7c6a86eaace', 'f0017389-02b6-480f-a300-a8a3bbb89141', '614848b6-d72b-471f-a16c-e1aef8101554', 'deb8a006-e123-49ed-bdb9-4e5763129460'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:19 devstack sudo[112129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:19 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:19 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.242s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:19 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Deleted volume successfully.
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e3582267-6d38-4dda-9ab6-a9978d2d747e tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-b9f6d396-1fb5-4058-923e-224871e8feaf-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "cinder-quobyte-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801bbe8-ea4d-4dfa-9c2f-e4507923a25a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:20 devstack sudo[112132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad
Aug 26 03:21:20 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:20 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad" returned: 0 in 0.479s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:20 devstack sudo[112138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad
Aug 26 03:21:20 devstack sudo[112138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:20 devstack sudo[112138]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad" returned: 0 in 0.250s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-quobyte-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad" released by "delete_volume" :: held 0.773s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Created reservations ['2ec6600e-c5f8-499c-88e7-efec03480f8e', 'e12a880b-0c6e-4dc8-9ec5-e126efd6fa8e', 'ad392e4d-2ce1-4abb-861c-96bb4ffaada0', '9a21f53f-030b-4679-9d9a-dabd8f376de2'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:20 devstack sudo[112141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:20 devstack sudo[112141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:21 devstack sudo[112141]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.312s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:21 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Deleted volume successfully.
Aug 26 03:21:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5c3e0a64-d216-419e-af1c-c4ab12b26c88 tempest-CreateVolumesFromImageTest-140055433 None] Lock "cinder-82a05aa6-5c4c-4ae2-acc2-bb8c71b187ad-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (e1f4b5ff-de21-4332-98ac-c09292736175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3073bf9d-59b7-4724-ba9f-8b99545b1035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3073bf9d-59b7-4724-ba9f-8b99545b1035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679999576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b0e311-619a-4c9d-b034-643bb7cc24e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:25Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2ee047-71f5-448d-a855-685464ed5591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2ee047-71f5-448d-a855-685464ed5591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90faf98-2bec-4c59-8bf8-089345f34a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90faf98-2bec-4c59-8bf8-089345f34a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b0e311-619a-4c9d-b034-643bb7cc24e1', 'volume_name': 'volume-62b0e311-619a-4c9d-b034-643bb7cc24e1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa15c72-29a1-4585-a333-8762f538302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa15c72-29a1-4585-a333-8762f538302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8c697-b77a-4f23-b1e0-102d81110f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:24 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume 62b0e311-619a-4c9d-b034-643bb7cc24e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b0e311-619a-4c9d-b034-643bb7cc24e1', 'volume_size': 1}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679999576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b0e311-619a-4c9d-b034-643bb7cc24e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:25Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating volume 62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:24 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:24 devstack sudo[112146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 1073741824
Aug 26 03:21:24 devstack sudo[112146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:25 devstack sudo[112146]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 1073741824" returned: 0 in 0.434s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:25 devstack sudo[112152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1
Aug 26 03:21:25 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:25 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1" returned: 0 in 0.266s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c8c697-b77a-4f23-b1e0-102d81110f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b0e311-619a-4c9d-b034-643bb7cc24e1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e598c7f-e3b8-45b9-9137-4592e07aa688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:25 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 (62b0e311-619a-4c9d-b034-643bb7cc24e1): created successfully
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e598c7f-e3b8-45b9-9137-4592e07aa688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (e1f4b5ff-de21-4332-98ac-c09292736175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-247826b8-f94d-4709-977e-d33e115b8812 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created volume successfully.
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating offline snapshot 99d8bf1b-9b2e-40aa-b022-f236a4cfd29b of volume 62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:21:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d106435-dca3-4dd1-9889-6d8ac7a36b20]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:26 devstack sudo[112155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1
Aug 26 03:21:26 devstack sudo[112155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:26 devstack sudo[112155]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:26 devstack sudo[112160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b 1G
Aug 26 03:21:26 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:26 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b 1G" returned: 0 in 0.410s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:26 devstack sudo[112165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b
Aug 26 03:21:26 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:27 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:27 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b is being set with open permissions: ugo+rw
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:27 devstack sudo[112170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b
Aug 26 03:21:27 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:27 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" returned: 0 in 0.281s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:27 devstack sudo[112173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info
Aug 26 03:21:27 devstack sudo[112173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:27 devstack sudo[112173]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info" returned: 0 in 0.277s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:27 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info is being set with open permissions: ugo+rw
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:27 devstack sudo[112176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info
Aug 26 03:21:27 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:27 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.info" returned: 0 in 0.241s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3981bba9-74ce-4bd9-a613-ac2a55a3b73e tempest-CreateVolumesFromSnapshotTest-721596883 None] Create snapshot completed successfully
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (c04c3d65-fb3f-4f08-b104-57a80693acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcd95e1-e549-4ea8-8830-0cf258fe9365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcd95e1-e549-4ea8-8830-0cf258fe9365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094770787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dc6241-3a98-4757-940d-7bad7b92059f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:30Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d597f5dd-cd54-4a1a-933a-2125148ede08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d597f5dd-cd54-4a1a-933a-2125148ede08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35fdb47-74c2-4382-8dfb-a9c8ac050473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35fdb47-74c2-4382-8dfb-a9c8ac050473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08dc6241-3a98-4757-940d-7bad7b92059f', 'volume_name': 'volume-08dc6241-3a98-4757-940d-7bad7b92059f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7084ae0-6b54-410f-a62c-f0318090fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7084ae0-6b54-410f-a62c-f0318090fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e683b-b0cf-421b-a946-00c84b7975cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:29 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume 08dc6241-3a98-4757-940d-7bad7b92059f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08dc6241-3a98-4757-940d-7bad7b92059f', 'volume_size': 1}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094770787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dc6241-3a98-4757-940d-7bad7b92059f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:30Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating volume 08dc6241-3a98-4757-940d-7bad7b92059f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:29 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:30 devstack sudo[112180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f 1073741824
Aug 26 03:21:30 devstack sudo[112180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (b2416af4-0195-4847-a5b5-f3cd06d92367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c920ca-d9e6-4e9b-826f-3928b7bdfb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c920ca-d9e6-4e9b-826f-3928b7bdfb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128874788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302708c2-01a6-4b7f-bb87-7e1f0f8bb3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:30Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49814ee4-3173-47bf-badc-8477d8a9c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49814ee4-3173-47bf-badc-8477d8a9c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8cf30d-93f0-4c5c-9872-846126c23e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8cf30d-93f0-4c5c-9872-846126c23e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302708c2-01a6-4b7f-bb87-7e1f0f8bb3db', 'volume_name': 'volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98e3068-b70e-4211-b27b-2e9954db6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98e3068-b70e-4211-b27b-2e9954db6d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df69ad8-8bcc-4492-ba53-7501b56c81aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:30 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume 302708c2-01a6-4b7f-bb87-7e1f0f8bb3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db', 'volume_size': 1}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:30 devstack sudo[112180]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f 1073741824" returned: 0 in 0.731s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:30 devstack sudo[112187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f
Aug 26 03:21:30 devstack sudo[112187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (d5494eba-845b-4b88-a82f-da98ede52153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1438192-a265-4f46-9688-0f433be0c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:30 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1438192-a265-4f46-9688-0f433be0c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712228610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8d8203-220c-4d23-99c1-86cb364ee02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:31Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9303dc0e-abc9-4944-8c6e-b9244c8a5526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9303dc0e-abc9-4944-8c6e-b9244c8a5526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced5120b-4a10-4139-8ab6-8b1ab0c2ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced5120b-4a10-4139-8ab6-8b1ab0c2ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb8d8203-220c-4d23-99c1-86cb364ee02e', 'volume_name': 'volume-bb8d8203-220c-4d23-99c1-86cb364ee02e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d307991-5099-47b6-8cac-bfdd9919eeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d307991-5099-47b6-8cac-bfdd9919eeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dd54ba-164b-4dfe-8c91-0ef1bd41dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume bb8d8203-220c-4d23-99c1-86cb364ee02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb8d8203-220c-4d23-99c1-86cb364ee02e', 'volume_size': 1}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:31 devstack sudo[112187]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f" returned: 0 in 0.373s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1128874788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302708c2-01a6-4b7f-bb87-7e1f0f8bb3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:30Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating volume 302708c2-01a6-4b7f-bb87-7e1f0f8bb3db {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:31 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e683b-b0cf-421b-a946-00c84b7975cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08dc6241-3a98-4757-940d-7bad7b92059f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90309796-3a42-442f-94e6-d8cf6e514f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack sudo[112190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db 1073741824
Aug 26 03:21:31 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume volume-08dc6241-3a98-4757-940d-7bad7b92059f (08dc6241-3a98-4757-940d-7bad7b92059f): created successfully
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90309796-3a42-442f-94e6-d8cf6e514f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (c04c3d65-fb3f-4f08-b104-57a80693acd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:31 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b58909ca-a664-45d1-89bc-fd994155e7cf tempest-CreateVolumesFromSnapshotTest-721596883 None] Created volume successfully.
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (0c793104-dc8c-4074-aefd-40d536e0f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc9da77-5d3d-4e50-b65f-ed5581e40073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc9da77-5d3d-4e50-b65f-ed5581e40073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075464275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b318300-e7d1-4ca8-a556-5b7e821d7f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:31Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51daa364-dd66-4836-a0d9-8df4b6a23aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51daa364-dd66-4836-a0d9-8df4b6a23aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e3dc11-4f4a-4612-a622-113dbfb01c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e3dc11-4f4a-4612-a622-113dbfb01c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b318300-e7d1-4ca8-a556-5b7e821d7f0f', 'volume_name': 'volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d79c9e-59bb-485b-b734-9f9768d02143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d79c9e-59bb-485b-b734-9f9768d02143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175f7a41-b08f-47d9-83a6-7d43b81305b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:31 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume 9b318300-e7d1-4ca8-a556-5b7e821d7f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f', 'volume_size': 1}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:31 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db 1073741824" returned: 0 in 0.649s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:31 devstack sudo[112196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db
Aug 26 03:21:31 devstack sudo[112196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:31 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (691a08f8-3d22-4651-b053-db1abfb3fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78430646-13d6-4bbe-9b3a-35d5f3b811f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78430646-13d6-4bbe-9b3a-35d5f3b811f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363191528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e610496b-5e28-4f59-afa3-04013d61737b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:32Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b55722a-b63b-4304-906a-b4d5236857a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b55722a-b63b-4304-906a-b4d5236857a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a9d1f9-99c8-45ec-bd3a-5ebd67820b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a9d1f9-99c8-45ec-bd3a-5ebd67820b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e610496b-5e28-4f59-afa3-04013d61737b', 'volume_name': 'volume-e610496b-5e28-4f59-afa3-04013d61737b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c69f646-83d9-460a-aa64-1be26df872d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c69f646-83d9-460a-aa64-1be26df872d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f502bfdc-dfa1-4694-9308-83f4cb537886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume e610496b-5e28-4f59-afa3-04013d61737b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e610496b-5e28-4f59-afa3-04013d61737b', 'volume_size': 1}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:32 devstack sudo[112196]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db" returned: 0 in 0.304s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-712228610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8d8203-220c-4d23-99c1-86cb364ee02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:31Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating volume bb8d8203-220c-4d23-99c1-86cb364ee02e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:32 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df69ad8-8bcc-4492-ba53-7501b56c81aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:32 devstack sudo[112199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e 1073741824
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e96cc70-747b-412d-819b-ea7df41ec3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:32 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db (302708c2-01a6-4b7f-bb87-7e1f0f8bb3db): created successfully
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e96cc70-747b-412d-819b-ea7df41ec3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (b2416af4-0195-4847-a5b5-f3cd06d92367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-45377ce7-c734-4cc4-8372-540fce60d005 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created volume successfully.
Aug 26 03:21:32 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e 1073741824" returned: 0 in 0.490s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:32 devstack sudo[112205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e
Aug 26 03:21:32 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:33 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e" returned: 0 in 0.374s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075464275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b318300-e7d1-4ca8-a556-5b7e821d7f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:31Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating volume 9b318300-e7d1-4ca8-a556-5b7e821d7f0f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:33 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:33 devstack sudo[112212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f 1073741824
Aug 26 03:21:33 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dd54ba-164b-4dfe-8c91-0ef1bd41dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8d8203-220c-4d23-99c1-86cb364ee02e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e037ac50-87ee-411d-8df6-ddfbc1a11148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume volume-bb8d8203-220c-4d23-99c1-86cb364ee02e (bb8d8203-220c-4d23-99c1-86cb364ee02e): created successfully
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e037ac50-87ee-411d-8df6-ddfbc1a11148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (d5494eba-845b-4b88-a82f-da98ede52153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-edf5527b-1ebe-42a6-a8c5-37c80a9e29f4 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created volume successfully.
Aug 26 03:21:33 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f 1073741824" returned: 0 in 0.578s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:33 devstack sudo[112218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f
Aug 26 03:21:33 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:34 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.949s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363191528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e610496b-5e28-4f59-afa3-04013d61737b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab2d59d9b6149179c627cae4f3db4d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:32Z,use_quota=True,user_id='f6781d6f97c143afbccf3abc115b824f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Creating volume e610496b-5e28-4f59-afa3-04013d61737b {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:34 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:34 devstack sudo[112222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b 1073741824
Aug 26 03:21:34 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175f7a41-b08f-47d9-83a6-7d43b81305b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba19cc65-e9bb-4eb4-9a4b-d986503b4b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:34 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f (9b318300-e7d1-4ca8-a556-5b7e821d7f0f): created successfully
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba19cc65-e9bb-4eb4-9a4b-d986503b4b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (0c793104-dc8c-4074-aefd-40d536e0f961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:34 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2b62dbf6-8866-474a-aca0-6b497c9099e6 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created volume successfully.
Aug 26 03:21:34 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b 1073741824" returned: 0 in 0.775s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:34 devstack sudo[112234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b
Aug 26 03:21:34 devstack sudo[112234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:35 devstack sudo[112234]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b" returned: 0 in 0.482s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f502bfdc-dfa1-4694-9308-83f4cb537886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e610496b-5e28-4f59-afa3-04013d61737b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e151de-4b5f-4dba-a976-30cea2380f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:35 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Volume volume-e610496b-5e28-4f59-afa3-04013d61737b (e610496b-5e28-4f59-afa3-04013d61737b): created successfully
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e151de-4b5f-4dba-a976-30cea2380f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:35 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Flow 'volume_create_manager' (691a08f8-3d22-4651-b053-db1abfb3fe11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1f50ecaa-1730-41ae-a1bb-1433c91d3a72 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created volume successfully.
Aug 26 03:21:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-f448c73d-cd5f-45be-ab2f-49df113bc4b5 tempest-TestShelveInstance-1281728214 None] Terminate volume connection completed successfully.
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-f448c73d-cd5f-45be-ab2f-49df113bc4b5 tempest-TestShelveInstance-1281728214 None] Deleting attachment 89d36618-59c4-4ada-bd8b-326f4402a6ac. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Acquiring lock "cinder-7c858024-a3a2-46b9-9271-d61a13b93094-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Lock "cinder-7c858024-a3a2-46b9-9271-d61a13b93094-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Acquiring lock "cinder-quobyte-7c858024-a3a2-46b9-9271-d61a13b93094" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Lock "cinder-quobyte-7c858024-a3a2-46b9-9271-d61a13b93094" acquired by "delete_volume" :: waited 0.035s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[23593650-542d-4091-902f-5e84b6013243]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-e610496b-5e28-4f59-afa3-04013d61737b-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:36 devstack sudo[112260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094
Aug 26 03:21:36 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-e610496b-5e28-4f59-afa3-04013d61737b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-e610496b-5e28-4f59-afa3-04013d61737b" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-e610496b-5e28-4f59-afa3-04013d61737b" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8506f944-4c19-4069-9593-1ae58a31a231]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:36 devstack sudo[112262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b
Aug 26 03:21:36 devstack sudo[112262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:37 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094" returned: 0 in 0.533s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:37 devstack sudo[112267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094
Aug 26 03:21:37 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:37 devstack sudo[112262]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b" returned: 0 in 0.411s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:37 devstack sudo[112272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b
Aug 26 03:21:37 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:37 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7c858024-a3a2-46b9-9271-d61a13b93094" returned: 0 in 0.311s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Lock "cinder-quobyte-7c858024-a3a2-46b9-9271-d61a13b93094" released by "delete_volume" :: held 0.911s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.quota [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Created reservations ['1af35c59-7c50-48b4-b6fa-90ee8ffe6375', '6db757b2-5ff6-4284-992a-a86c64fbc9f3', 'a80e10cb-2c4c-41cf-b22b-0d8a6edf3310', '0152059f-a001-4ea0-81a2-c670dbc5cc47'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:37 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e610496b-5e28-4f59-afa3-04013d61737b" returned: 0 in 0.283s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-e610496b-5e28-4f59-afa3-04013d61737b" released by "delete_volume" :: held 0.758s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:37 devstack sudo[112276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:37 devstack sudo[112276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['8a9f1efd-1a56-40b7-befa-275da9ffda87', 'b1b8708c-054d-47ae-99f9-721f4ffef46f', '59ca28b3-cec2-48a5-810f-93727e48aaf6', '14f93252-235c-444c-b17c-4c3300a8e77d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:37 devstack sudo[112278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:37 devstack sudo[112278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:37 devstack sudo[112276]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.366s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.manager [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Deleted volume successfully.
Aug 26 03:21:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-9b318300-e7d1-4ca8-a556-5b7e821d7f0f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-9b318300-e7d1-4ca8-a556-5b7e821d7f0f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [req-0e2bdc69-67de-4f32-b4f8-46365ef289b9 req-9cb65850-2b1e-4199-8ac5-f98c02673496 tempest-TestShelveInstance-1281728214 None] Lock "cinder-7c858024-a3a2-46b9-9271-d61a13b93094-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:38 devstack sudo[112278]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-9b318300-e7d1-4ca8-a556-5b7e821d7f0f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.380s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleted volume successfully.
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-9b318300-e7d1-4ca8-a556-5b7e821d7f0f" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7389957a-fc10-42a9-9bb8-d748046046e5 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-e610496b-5e28-4f59-afa3-04013d61737b-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df09c9c-3901-4f70-9d98-fc47795b7412]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:38 devstack sudo[112282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f
Aug 26 03:21:38 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:38 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f" returned: 0 in 0.438s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:38 devstack sudo[112287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f
Aug 26 03:21:38 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:38 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9b318300-e7d1-4ca8-a556-5b7e821d7f0f" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-9b318300-e7d1-4ca8-a556-5b7e821d7f0f" released by "delete_volume" :: held 0.816s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:38 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['5a0e9759-a473-4b44-b0fe-5866aa14b8c9', '946d44ad-4084-42ff-b079-31804c086d1f', 'af1798b7-69d7-4c8e-ae90-791a9306b10d', 'bf7b5fc7-4130-4c48-9095-ab31d15af1af'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:39 devstack sudo[112290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:39 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-bb8d8203-220c-4d23-99c1-86cb364ee02e-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-bb8d8203-220c-4d23-99c1-86cb364ee02e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-bb8d8203-220c-4d23-99c1-86cb364ee02e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-bb8d8203-220c-4d23-99c1-86cb364ee02e" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6dcdf7-e7eb-4a33-9aaf-8a7b8d6e182e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:39 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.381s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleted volume successfully.
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6652f513-be0a-4cab-9f7d-83f0c3f59210 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-9b318300-e7d1-4ca8-a556-5b7e821d7f0f-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:39 devstack sudo[112294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e
Aug 26 03:21:39 devstack sudo[112294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:39 devstack sudo[112294]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e" returned: 0 in 0.437s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:39 devstack sudo[112300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e
Aug 26 03:21:39 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:40 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-bb8d8203-220c-4d23-99c1-86cb364ee02e" returned: 0 in 0.356s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-bb8d8203-220c-4d23-99c1-86cb364ee02e" released by "delete_volume" :: held 0.862s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['7e59ed1f-4459-4958-945b-f97fd3577697', '22fb6bf6-4eb1-4560-b2b2-93ec935eccfc', 'f74b4eb7-6547-4c17-9bc1-aa322a6b8b43', 'c5a25bbf-8ba4-4876-aec3-cd32c1edaa57'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:40 devstack sudo[112304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:40 devstack sudo[112304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36bb7c-64ce-46ac-a978-5159f4b86d8b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:40 devstack sudo[112304]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleted volume successfully.
Aug 26 03:21:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3a70a66e-5399-4be2-aaa2-1c2fcd22093e tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-bb8d8203-220c-4d23-99c1-86cb364ee02e-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:40 devstack sudo[112306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db
Aug 26 03:21:40 devstack sudo[112306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:41 devstack sudo[112306]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db" returned: 0 in 0.462s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:41 devstack sudo[112312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db
Aug 26 03:21:41 devstack sudo[112312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:41 devstack sudo[112312]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db" released by "delete_volume" :: held 0.843s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['be6631e3-c611-41d3-9399-06948d93c55f', '42d51ec4-baa9-457f-8d8c-1e6e16f8d153', 'f7ac0f01-6e5c-4adf-a99e-5a651b5ee8ee', 'ade27859-a30a-4e0f-99a2-f6e433821c01'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-08dc6241-3a98-4757-940d-7bad7b92059f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:41 devstack sudo[112315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:41 devstack sudo[112315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-08dc6241-3a98-4757-940d-7bad7b92059f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-08dc6241-3a98-4757-940d-7bad7b92059f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-08dc6241-3a98-4757-940d-7bad7b92059f" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb0e8e5-a1ba-4037-aa53-2463a68df72b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:41 devstack sudo[112317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f
Aug 26 03:21:41 devstack sudo[112317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:41 devstack sudo[112315]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleted volume successfully.
Aug 26 03:21:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5aae0f03-c2af-4c5c-ac05-e15404f8adfa tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-302708c2-01a6-4b7f-bb87-7e1f0f8bb3db-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:42 devstack sudo[112317]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:42 devstack sudo[112323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f
Aug 26 03:21:42 devstack sudo[112323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:42 devstack sudo[112323]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-08dc6241-3a98-4757-940d-7bad7b92059f" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-08dc6241-3a98-4757-940d-7bad7b92059f" released by "delete_volume" :: held 0.724s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['6fc2f5ed-9cff-4adf-b5f5-672b26aee5ad', 'c26aa4f4-7826-4a16-8e39-d6e47dbb811d', '9f7f2648-e85c-41c2-a0e0-e7077a839f4c', 'a79107e3-12cd-4621-b458-804cc3753bfe'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:42 devstack sudo[112326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:42 devstack sudo[112326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-99d8bf1b-9b2e-40aa-b022-f236a4cfd29b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-99d8bf1b-9b2e-40aa-b022-f236a4cfd29b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-62b0e311-619a-4c9d-b034-643bb7cc24e1" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-62b0e311-619a-4c9d-b034-643bb7cc24e1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleting offline snapshot 99d8bf1b-9b2e-40aa-b022-f236a4cfd29b of volume 62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] snapshot_file for this snap is: volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a638d3d-7ca3-4d31-89fb-ae49d4495737]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:43 devstack sudo[112326]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleted volume successfully.
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-48e4ab15-0d97-4415-b970-8ed93047b830 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-08dc6241-3a98-4757-940d-7bad7b92059f-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:43 devstack sudo[112329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b
Aug 26 03:21:43 devstack sudo[112329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:43 devstack sudo[112329]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b0e311-619a-4c9d-b034-643bb7cc24e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f062ee4-f891-4718-beac-c9dd76b6b446]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:43 devstack sudo[112335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1
Aug 26 03:21:43 devstack sudo[112335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:43 devstack sudo[112335]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1" returned: 0 in 0.453s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:44 devstack sudo[112340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b
Aug 26 03:21:44 devstack sudo[112340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:44 devstack sudo[112340]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" returned: 0 in 0.385s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:44 devstack sudo[112346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b
Aug 26 03:21:44 devstack sudo[112346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:44 devstack sudo[112346]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1.99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" returned: 0 in 0.289s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-99d8bf1b-9b2e-40aa-b022-f236a4cfd29b" released by "_delete_snapshot" :: held 1.728s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-62b0e311-619a-4c9d-b034-643bb7cc24e1" released by "delete_snapshot" :: held 1.768s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['b802edfb-cb8a-45be-b01d-cc4678f6bf53', '1408c35d-8c6b-4b4a-aa81-f09dfbb44163', '2b765155-41bf-472e-b205-9cd5355ca8e1', '19a34868-a7ba-4cea-9140-3826853cc7b9'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Delete snapshot completed successfully.
Aug 26 03:21:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e0c317dd-61b9-40e7-b81c-fd810c7c8a02 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-99d8bf1b-9b2e-40aa-b022-f236a4cfd29b-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-62b0e311-619a-4c9d-b034-643bb7cc24e1-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-62b0e311-619a-4c9d-b034-643bb7cc24e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "cinder-quobyte-62b0e311-619a-4c9d-b034-643bb7cc24e1" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-62b0e311-619a-4c9d-b034-643bb7cc24e1" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc1c97e-9bf6-4e4c-ae71-adfc2321e57a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:45 devstack sudo[112350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1
Aug 26 03:21:45 devstack sudo[112350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:45 devstack sudo[112350]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1" returned: 0 in 0.529s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:45 devstack sudo[112389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1
Aug 26 03:21:45 devstack sudo[112389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:46 devstack sudo[112389]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-62b0e311-619a-4c9d-b034-643bb7cc24e1" returned: 0 in 0.267s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-quobyte-62b0e311-619a-4c9d-b034-643bb7cc24e1" released by "delete_volume" :: held 0.884s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Created reservations ['9410593e-4d92-4bc1-a096-eb9b1cab9ecc', 'ad8dd721-643c-47fb-bf44-0073846fdf52', 'fe5e8aa3-6deb-4bac-a1d1-fe6ea3214d72', 'f28cfb86-2921-4960-acfa-cc4d0750a240'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:46 devstack sudo[112394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:21:46 devstack sudo[112394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:46 devstack sudo[112394]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:21:46 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Deleted volume successfully.
Aug 26 03:21:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-522759e2-d13c-4d89-94a0-1317c946ad52 tempest-CreateVolumesFromSnapshotTest-721596883 None] Lock "cinder-62b0e311-619a-4c9d-b034-643bb7cc24e1-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Flow 'volume_create_manager' (95e6433d-db8d-425d-bdb7-523f689900d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1783198b-945a-4d91-8c8f-a9de6aa82e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1783198b-945a-4d91-8c8f-a9de6aa82e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2041882565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8792af-3eaf-4583-9e58-b167d5e3b45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3406a717d2c4405f945959eabd37b0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:51Z,use_quota=True,user_id='7574a1504b7f41079c7528e20935bfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be4fb3-7a35-440e-bc5e-b7788662780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be4fb3-7a35-440e-bc5e-b7788662780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85575d83-7fae-452a-9562-2f11767442ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85575d83-7fae-452a-9562-2f11767442ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8792af-3eaf-4583-9e58-b167d5e3b45d', 'volume_name': 'volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff54ec75-5b8d-42e1-93ff-cdd45fbd8cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff54ec75-5b8d-42e1-93ff-cdd45fbd8cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae48af87-42f5-4603-b1e2-d664c8d8855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:51 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Volume ff8792af-3eaf-4583-9e58-b167d5e3b45d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d', 'volume_size': 1}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2041882565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8792af-3eaf-4583-9e58-b167d5e3b45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3406a717d2c4405f945959eabd37b0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:51Z,use_quota=True,user_id='7574a1504b7f41079c7528e20935bfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Creating volume ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:51 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:51 devstack sudo[112405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d 1073741824
Aug 26 03:21:51 devstack sudo[112405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:52 devstack sudo[112405]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d 1073741824" returned: 0 in 0.574s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:52 devstack sudo[112411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d
Aug 26 03:21:52 devstack sudo[112411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:52 devstack sudo[112411]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d" returned: 0 in 0.357s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae48af87-42f5-4603-b1e2-d664c8d8855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa294b8-814f-4de3-b279-011e38b8da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:52 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Volume volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d (ff8792af-3eaf-4583-9e58-b167d5e3b45d): created successfully
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa294b8-814f-4de3-b279-011e38b8da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:52 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Flow 'volume_create_manager' (95e6433d-db8d-425d-bdb7-523f689900d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e3bcfb0d-3242-4904-aaf4-e1f1a5348fab tempest-TestStampPattern-1587066898 None] Created volume successfully.
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (fc180d84-6c93-48dd-8aae-32f39805815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586f60a4-0c39-4281-a98e-c5cca5d4067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586f60a4-0c39-4281-a98e-c5cca5d4067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971793264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200a0f40-ac4c-4b39-8648-3a04b65ba135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:54Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0a144c-fa9f-4eeb-8bc1-5b8a21364aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c0a144c-fa9f-4eeb-8bc1-5b8a21364aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afea477a-fc67-4602-9ee0-400621986456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afea477a-fc67-4602-9ee0-400621986456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200a0f40-ac4c-4b39-8648-3a04b65ba135', 'volume_name': 'volume-200a0f40-ac4c-4b39-8648-3a04b65ba135', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb783ef-7c13-46bd-9c14-6d94ef8ef5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb783ef-7c13-46bd-9c14-6d94ef8ef5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51444780-0d75-4733-9fac-45d6c7d40342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:53 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume 200a0f40-ac4c-4b39-8648-3a04b65ba135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200a0f40-ac4c-4b39-8648-3a04b65ba135', 'volume_size': 1}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971793264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200a0f40-ac4c-4b39-8648-3a04b65ba135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:54Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Creating volume 200a0f40-ac4c-4b39-8648-3a04b65ba135 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:53 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:53 devstack sudo[112417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 1073741824
Aug 26 03:21:53 devstack sudo[112417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:54 devstack sudo[112417]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 1073741824" returned: 0 in 0.608s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:54 devstack sudo[112424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135
Aug 26 03:21:54 devstack sudo[112424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:54 devstack sudo[112424]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135" returned: 0 in 0.402s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51444780-0d75-4733-9fac-45d6c7d40342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200a0f40-ac4c-4b39-8648-3a04b65ba135', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982a4ba1-1382-4ec5-b243-d8c2fcf6d88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 (200a0f40-ac4c-4b39-8648-3a04b65ba135): created successfully
Aug 26 03:21:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982a4ba1-1382-4ec5-b243-d8c2fcf6d88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (fc180d84-6c93-48dd-8aae-32f39805815d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-79652ed1-be22-42dd-ab89-1631dba29cfb tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created volume successfully.
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (229e2adf-3871-44bf-bacd-e61d90682b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1cae25-f520-4362-93f1-8d8b6952d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1cae25-f520-4362-93f1-8d8b6952d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884230152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3121c7d6-0578-4996-9775-619096917440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:57Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f696a4c-2a89-46c2-995c-f1b0e2c43281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f696a4c-2a89-46c2-995c-f1b0e2c43281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c33a156-014b-454d-8007-42cbd5a12ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c33a156-014b-454d-8007-42cbd5a12ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3121c7d6-0578-4996-9775-619096917440', 'volume_name': 'volume-3121c7d6-0578-4996-9775-619096917440', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c167e4f4-6e8c-46cb-94bc-10fe8d181b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c167e4f4-6e8c-46cb-94bc-10fe8d181b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c893ca32-4647-4f89-bc8d-0a9beaa07816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:56 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume 3121c7d6-0578-4996-9775-619096917440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3121c7d6-0578-4996-9775-619096917440', 'volume_size': 1}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884230152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3121c7d6-0578-4996-9775-619096917440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:57Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Creating volume 3121c7d6-0578-4996-9775-619096917440 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:56 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:56 devstack sudo[112443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440 1073741824
Aug 26 03:21:56 devstack sudo[112443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (0b723d12-2eb4-40a5-b3bb-07c3cd018295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a3199a-b25b-4634-9d0c-05740fc12548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a3199a-b25b-4634-9d0c-05740fc12548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915679996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c6fdff-618b-4725-b43b-d677b1a60420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:57Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e77808-b034-44b3-83fe-a09654311bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e77808-b034-44b3-83fe-a09654311bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc90af08-4aff-4f4b-9e85-2847770c9461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc90af08-4aff-4f4b-9e85-2847770c9461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c6fdff-618b-4725-b43b-d677b1a60420', 'volume_name': 'volume-f6c6fdff-618b-4725-b43b-d677b1a60420', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d4d1b4-efc6-4c6f-8915-404daecc8f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d4d1b4-efc6-4c6f-8915-404daecc8f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16183df9-0653-4ad9-b04e-7e0bf78c37b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:57 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume f6c6fdff-618b-4725-b43b-d677b1a60420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c6fdff-618b-4725-b43b-d677b1a60420', 'volume_size': 1}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:57 devstack sudo[112443]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440 1073741824" returned: 0 in 1.018s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:58 devstack sudo[112467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440
Aug 26 03:21:58 devstack sudo[112467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (dbdc3930-807a-4d9b-831f-f1155cfceec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24d9240-e5e9-465a-b923-84fc6f8edffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24d9240-e5e9-465a-b923-84fc6f8edffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-955240980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7422caaf-016e-4ada-93f2-c1b45d850cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:58Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1051837-a7ca-4482-a392-90c14c5d308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1051837-a7ca-4482-a392-90c14c5d308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4326a145-f08a-4833-837d-d421618c1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4326a145-f08a-4833-837d-d421618c1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7422caaf-016e-4ada-93f2-c1b45d850cf1', 'volume_name': 'volume-7422caaf-016e-4ada-93f2-c1b45d850cf1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67e4591-2af0-449e-a209-81e3d84a8657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67e4591-2af0-449e-a209-81e3d84a8657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b3b83-f73a-4cb5-969a-e956f247218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:58 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume 7422caaf-016e-4ada-93f2-c1b45d850cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7422caaf-016e-4ada-93f2-c1b45d850cf1', 'volume_size': 1}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:58 devstack sudo[112467]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440" returned: 0 in 0.617s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.133s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915679996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c6fdff-618b-4725-b43b-d677b1a60420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:57Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Creating volume f6c6fdff-618b-4725-b43b-d677b1a60420 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:21:58 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:58 devstack sudo[112493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420 1073741824
Aug 26 03:21:58 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c893ca32-4647-4f89-bc8d-0a9beaa07816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3121c7d6-0578-4996-9775-619096917440', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff6408e-b435-4d24-b421-1ec13a31e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:58 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume volume-3121c7d6-0578-4996-9775-619096917440 (3121c7d6-0578-4996-9775-619096917440): created successfully
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff6408e-b435-4d24-b421-1ec13a31e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (229e2adf-3871-44bf-bacd-e61d90682b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:58 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d0ec9584-44b0-4209-a078-70c0d757831a tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created volume successfully.
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (71a434ed-d7b2-4cd1-b5a3-51f4f882a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:58 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b80810-8389-46c4-ab2e-e5844d07ae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b80810-8389-46c4-ab2e-e5844d07ae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812833937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad4d1d5-7b84-4cf8-9144-003e431d495f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:59Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c9a0ae-664a-4e98-b94a-a608f7c7dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c9a0ae-664a-4e98-b94a-a608f7c7dfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e5e486-efb7-40e3-9438-832ca5d6c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e5e486-efb7-40e3-9438-832ca5d6c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad4d1d5-7b84-4cf8-9144-003e431d495f', 'volume_name': 'volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f2f7c4-1487-4c47-bd26-9a1f2ac198d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f2f7c4-1487-4c47-bd26-9a1f2ac198d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0ecba0-e2ad-4d46-be8c-ecc0806a8f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume 2ad4d1d5-7b84-4cf8-9144-003e431d495f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f', 'volume_size': 1}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:59 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (05b555bc-c175-4ef6-b172-4991501aee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bfd8e0-87ea-452f-a95d-91567f96d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420 1073741824" returned: 0 in 1.195s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bfd8e0-87ea-452f-a95d-91567f96d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891148978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43171967-aa92-44ba-ba0b-959b67367376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:00Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb410a08-2c4a-4164-bdc8-346f4fc00801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb410a08-2c4a-4164-bdc8-346f4fc00801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc58fbe2-6e66-494d-a2fa-09d3c4f47544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc58fbe2-6e66-494d-a2fa-09d3c4f47544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43171967-aa92-44ba-ba0b-959b67367376', 'volume_name': 'volume-43171967-aa92-44ba-ba0b-959b67367376', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f253a5-eab0-4d63-ba1b-26f2b58c92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f253a5-eab0-4d63-ba1b-26f2b58c92d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a357a7fe-8dbf-4415-87f6-40c6a0b72b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:21:59 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume 43171967-aa92-44ba-ba0b-959b67367376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43171967-aa92-44ba-ba0b-959b67367376', 'volume_size': 1}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:21:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:21:59 devstack sudo[112531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420
Aug 26 03:21:59 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:00 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420" returned: 0 in 0.298s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-955240980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7422caaf-016e-4ada-93f2-c1b45d850cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:58Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Creating volume 7422caaf-016e-4ada-93f2-c1b45d850cf1 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:00 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16183df9-0653-4ad9-b04e-7e0bf78c37b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c6fdff-618b-4725-b43b-d677b1a60420', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4937a33a-7ddd-4555-ad59-c105d6e395ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:00 devstack sudo[112544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 1073741824
Aug 26 03:22:00 devstack sudo[112544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume volume-f6c6fdff-618b-4725-b43b-d677b1a60420 (f6c6fdff-618b-4725-b43b-d677b1a60420): created successfully
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4937a33a-7ddd-4555-ad59-c105d6e395ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (0b723d12-2eb4-40a5-b3bb-07c3cd018295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:00 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b8d000cf-c50a-46e4-b33e-13d6da0df8e8 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created volume successfully.
Aug 26 03:22:00 devstack sudo[112544]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 1073741824" returned: 0 in 0.615s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:00 devstack sudo[112550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1
Aug 26 03:22:00 devstack sudo[112550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:01 devstack sudo[112550]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812833937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad4d1d5-7b84-4cf8-9144-003e431d495f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:21:59Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Creating volume 2ad4d1d5-7b84-4cf8-9144-003e431d495f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:01 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b3b83-f73a-4cb5-969a-e956f247218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7422caaf-016e-4ada-93f2-c1b45d850cf1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9937b58f-7f1b-4346-b25c-b5dacb78a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:01 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 (7422caaf-016e-4ada-93f2-c1b45d850cf1): created successfully
Aug 26 03:22:01 devstack sudo[112555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f 1073741824
Aug 26 03:22:01 devstack sudo[112555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9937b58f-7f1b-4346-b25c-b5dacb78a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (dbdc3930-807a-4d9b-831f-f1155cfceec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6420817f-e240-4ae6-8dcd-84226a1fd81c tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created volume successfully.
Aug 26 03:22:01 devstack sudo[112555]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f 1073741824" returned: 0 in 0.642s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:01 devstack sudo[112562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f
Aug 26 03:22:01 devstack sudo[112562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:02 devstack sudo[112562]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f" returned: 0 in 0.267s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891148978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43171967-aa92-44ba-ba0b-959b67367376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c048ddb92f44acb3c778a03038c787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:00Z,use_quota=True,user_id='f4883913b41f4abfa97da57db256f63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Creating volume 43171967-aa92-44ba-ba0b-959b67367376 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:02 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0ecba0-e2ad-4d46-be8c-ecc0806a8f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:02 devstack sudo[112565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376 1073741824
Aug 26 03:22:02 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4291217-dfec-48da-9759-2f481b33336e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:02 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f (2ad4d1d5-7b84-4cf8-9144-003e431d495f): created successfully
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4291217-dfec-48da-9759-2f481b33336e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:02 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (71a434ed-d7b2-4cd1-b5a3-51f4f882a884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9bd5c535-2d79-4cf9-9bc2-53229aea896b tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created volume successfully.
Aug 26 03:22:03 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376 1073741824" returned: 0 in 0.849s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:03 devstack sudo[112573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376
Aug 26 03:22:03 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:03 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376" returned: 0 in 0.361s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=100,cinder:INSERT=40,cinder:UPDATE=172,cinder:DELETE=15 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a357a7fe-8dbf-4415-87f6-40c6a0b72b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43171967-aa92-44ba-ba0b-959b67367376', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94367137-c6b0-4982-a049-cbd026054731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:03 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Volume volume-43171967-aa92-44ba-ba0b-959b67367376 (43171967-aa92-44ba-ba0b-959b67367376): created successfully
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94367137-c6b0-4982-a049-cbd026054731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Flow 'volume_create_manager' (05b555bc-c175-4ef6-b172-4991501aee31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-addfb98e-3568-4f7f-8b38-efa9e6463818 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created volume successfully.
Aug 26 03:22:03 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=124,cinder:UPDATE=157,cinder:INSERT=35,cinder:DELETE=17 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-43171967-aa92-44ba-ba0b-959b67367376-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-43171967-aa92-44ba-ba0b-959b67367376-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-quobyte-43171967-aa92-44ba-ba0b-959b67367376" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-43171967-aa92-44ba-ba0b-959b67367376" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ec69dc-ae3e-4081-b9f7-ced810e464ff]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:04 devstack sudo[112582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376
Aug 26 03:22:04 devstack sudo[112582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:04 devstack sudo[112582]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376" returned: 0 in 0.519s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:05 devstack sudo[112588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376
Aug 26 03:22:05 devstack sudo[112588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:05 devstack sudo[112588]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-43171967-aa92-44ba-ba0b-959b67367376" returned: 0 in 0.305s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-43171967-aa92-44ba-ba0b-959b67367376" released by "delete_volume" :: held 0.905s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created reservations ['2e4c8a10-1fd4-4ee1-b4a8-f5c945847502', '98f077cb-c413-4600-b106-8f85ea2a5daa', '8272e44a-5406-48e7-be72-dd033c3a720b', '2d5eab2e-cb5f-43ba-956b-2f5c4afb4137'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:05 devstack sudo[112591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:05 devstack sudo[112591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:05 devstack sudo[112591]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Deleted volume successfully.
Aug 26 03:22:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-407555aa-aea8-443f-9304-3882502dc763 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-43171967-aa92-44ba-ba0b-959b67367376-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-2ad4d1d5-7b84-4cf8-9144-003e431d495f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-2ad4d1d5-7b84-4cf8-9144-003e431d495f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-quobyte-2ad4d1d5-7b84-4cf8-9144-003e431d495f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-2ad4d1d5-7b84-4cf8-9144-003e431d495f" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e33335-bf58-49cf-9588-c8adf0725a7f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:06 devstack sudo[112596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f
Aug 26 03:22:06 devstack sudo[112596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:07 devstack sudo[112596]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f" returned: 0 in 0.536s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:07 devstack sudo[112601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f
Aug 26 03:22:07 devstack sudo[112601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:07 devstack sudo[112601]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2ad4d1d5-7b84-4cf8-9144-003e431d495f" returned: 0 in 0.282s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-2ad4d1d5-7b84-4cf8-9144-003e431d495f" released by "delete_volume" :: held 0.874s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created reservations ['962df499-9c06-4095-8814-f2c4d065016d', '62043fad-98c9-43bc-8a70-b8e1c0d522bf', '7e848178-6766-4cfe-a064-6cfbad594435', 'c2aca3f9-ef42-4ef1-a660-08e317a81aef'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:07 devstack sudo[112604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:07 devstack sudo[112604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-7422caaf-016e-4ada-93f2-c1b45d850cf1-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-7422caaf-016e-4ada-93f2-c1b45d850cf1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-quobyte-7422caaf-016e-4ada-93f2-c1b45d850cf1" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-7422caaf-016e-4ada-93f2-c1b45d850cf1" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1437e3-cd2d-4b7f-bc31-514052b809bc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:08 devstack sudo[112606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1
Aug 26 03:22:08 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:08 devstack sudo[112604]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.466s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Deleted volume successfully.
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-15025857-4c40-4d8d-9f09-692d386336b3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-2ad4d1d5-7b84-4cf8-9144-003e431d495f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:08 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1" returned: 0 in 0.437s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:08 devstack sudo[112612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1
Aug 26 03:22:08 devstack sudo[112612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:08 devstack sudo[112612]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7422caaf-016e-4ada-93f2-c1b45d850cf1" returned: 0 in 0.481s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-7422caaf-016e-4ada-93f2-c1b45d850cf1" released by "delete_volume" :: held 0.970s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created reservations ['458e476c-8047-4e4c-9dff-8be67021e00d', 'dadb9418-2c12-4d42-8886-55d52f8234e2', '618d57c9-5ec3-47d4-b72b-c2823ba414c5', '7fe854a2-bb86-411e-8f6a-c44d4cc8c78f'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:09 devstack sudo[112615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:09 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:09 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.321s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Deleted volume successfully.
Aug 26 03:22:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-30988297-05d5-47db-9213-6dc82f0fe342 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-7422caaf-016e-4ada-93f2-c1b45d850cf1-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-f6c6fdff-618b-4725-b43b-d677b1a60420-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-f6c6fdff-618b-4725-b43b-d677b1a60420-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-quobyte-f6c6fdff-618b-4725-b43b-d677b1a60420" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-f6c6fdff-618b-4725-b43b-d677b1a60420" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8281be4-9320-4d54-a5f1-cfe959078cfc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:10 devstack sudo[112619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420
Aug 26 03:22:10 devstack sudo[112619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:10 devstack sudo[112619]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420" returned: 0 in 0.421s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:10 devstack sudo[112625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420
Aug 26 03:22:10 devstack sudo[112625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:10 devstack sudo[112625]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f6c6fdff-618b-4725-b43b-d677b1a60420" returned: 0 in 0.288s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-f6c6fdff-618b-4725-b43b-d677b1a60420" released by "delete_volume" :: held 0.779s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created reservations ['ad44da25-1d07-410d-9648-963b3081e3cd', '8fbfbcd0-269e-428f-a7a4-8e6722776fca', 'e0528847-df4b-430f-bae5-e867b4e489cb', 'dcb30e6e-d85c-4f06-ba38-5ec6ae6dbc84'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:11 devstack sudo[112628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:11 devstack sudo[112628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-3121c7d6-0578-4996-9775-619096917440-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-3121c7d6-0578-4996-9775-619096917440-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-quobyte-3121c7d6-0578-4996-9775-619096917440" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-3121c7d6-0578-4996-9775-619096917440" acquired by "delete_volume" :: waited 0.039s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4307661d-f7a9-4b5a-a577-4d1341c01310]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:11 devstack sudo[112628]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Deleted volume successfully.
Aug 26 03:22:11 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9bf4156e-ee9f-4b39-a79b-80471b80999f tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-f6c6fdff-618b-4725-b43b-d677b1a60420-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:11 devstack sudo[112632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440
Aug 26 03:22:11 devstack sudo[112632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:12 devstack sudo[112632]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440" returned: 0 in 0.438s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:12 devstack sudo[112637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440
Aug 26 03:22:12 devstack sudo[112637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:12 devstack sudo[112637]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3121c7d6-0578-4996-9775-619096917440" returned: 0 in 0.314s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-3121c7d6-0578-4996-9775-619096917440" released by "delete_volume" :: held 0.797s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created reservations ['f7eed966-6f6b-4758-9568-d866c89c9f8b', '917320c8-f78a-4d6f-a4f3-19ee4fbc39ab', '6e3ff5d5-0490-4370-b36e-c6d869c18963', '75dbdeb6-3b54-43dc-9bfe-dca522f76fc3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:12 devstack sudo[112640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:12 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:12 devstack sudo[112642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:12 devstack sudo[112642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-200a0f40-ac4c-4b39-8648-3a04b65ba135-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-200a0f40-ac4c-4b39-8648-3a04b65ba135-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:12 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.401s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Deleted volume successfully.
Aug 26 03:22:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "cinder-quobyte-200a0f40-ac4c-4b39-8648-3a04b65ba135" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-200a0f40-ac4c-4b39-8648-3a04b65ba135" acquired by "delete_volume" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4d0cc110-9c7d-478b-94ac-946f504f13de tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-3121c7d6-0578-4996-9775-619096917440-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc65641-00e6-4306-ac09-994cef9e8438]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:13 devstack sudo[112642]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.476s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:22:13 devstack sudo[112646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135
Aug 26 03:22:13 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:13 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135" returned: 0 in 0.430s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:13 devstack sudo[112670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135
Aug 26 03:22:13 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:13 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-200a0f40-ac4c-4b39-8648-3a04b65ba135" returned: 0 in 0.350s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-quobyte-200a0f40-ac4c-4b39-8648-3a04b65ba135" released by "delete_volume" :: held 0.856s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:13 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Created reservations ['8bdcef4e-f7d6-4302-afec-4f02fb4dc15f', '3f100941-363c-4f52-ae04-7ed70086358e', '990a61c9-0550-4878-af68-f9d5fc04ad51', 'b51ff8b5-90f0-443e-9386-0a9b9256a0f9'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:14 devstack sudo[112673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:14 devstack sudo[112673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:14 devstack sudo[112673]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.356s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Deleted volume successfully.
Aug 26 03:22:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4634db32-e5f9-4a34-a18e-6613ca7979d3 tempest-CreateVolumesFromSourceVolumeTest-708494130 None] Lock "cinder-200a0f40-ac4c-4b39-8648-3a04b65ba135-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Flow 'volume_create_manager' (45101112-a864-4625-b8e5-6acf5c253c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9361ac6-1b7b-4e99-abc0-e4bced68cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9361ac6-1b7b-4e99-abc0-e4bced68cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aed201d-6130-4d39-aaff-a774a5de2427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead5d6505fd44dd89e5c088709d094f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:21Z,use_quota=True,user_id='93e8e588c48c439691cb81a5ea7083dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1c6142-d8d1-416a-a035-e39eb57d313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1c6142-d8d1-416a-a035-e39eb57d313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c40f2be-3fbd-495a-a477-3024c8cfcf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:20 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c40f2be-3fbd-495a-a477-3024c8cfcf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2aed201d-6130-4d39-aaff-a774a5de2427', 'volume_name': 'volume-2aed201d-6130-4d39-aaff-a774a5de2427', 'volume_size': 1, 'image_id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '271e0dc3c0ea65a8b1219484b4089e21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ead5d6505fd44dd89e5c088709d094f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a779c7c827e55ffad276bb9618d7ac4d39c5a293fbae45707e98fa5e48914e40d8c5a858eb6dc995044ab1387ee3f991825b92288f50f4fec815c8000538a0d', 'id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'created_at': datetime.datetime(2026, 8, 26, 1, 22, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 22, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b89a00>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a32886a-1949-445e-9b82-fe9545633b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a32886a-1949-445e-9b82-fe9545633b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acc918b-bad0-4de5-bc60-cb29d99b672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Volume 2aed201d-6130-4d39-aaff-a774a5de2427: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2aed201d-6130-4d39-aaff-a774a5de2427', 'volume_size': 1, 'image_id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '271e0dc3c0ea65a8b1219484b4089e21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ead5d6505fd44dd89e5c088709d094f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a779c7c827e55ffad276bb9618d7ac4d39c5a293fbae45707e98fa5e48914e40d8c5a858eb6dc995044ab1387ee3f991825b92288f50f4fec815c8000538a0d', 'id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'created_at': datetime.datetime(2026, 8, 26, 1, 22, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 22, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b89a00>}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Trying to clone 2aed201d-6130-4d39-aaff-a774a5de2427 from image 3e336504-1ee2-4368-b3a7-a31e6e325ffe at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:22:21 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c392d4-f6e9-479d-a400-1f082eb75fea]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:21 devstack sudo[112680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD
Aug 26 03:22:21 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:21 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:21 devstack sudo[112684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD
Aug 26 03:22:21 devstack sudo[112684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:22 devstack sudo[112684]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Temporary image 3e336504-1ee2-4368-b3a7-a31e6e325ffe is fetched for user 93e8e588c48c439691cb81a5ea7083dd. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b200d5fb-1780-4aee-bc95-8e49cb04cd67]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:22 devstack sudo[112689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD
Aug 26 03:22:22 devstack sudo[112689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:22 devstack sudo[112689]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:22 devstack sudo[112693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD
Aug 26 03:22:22 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:23 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD" returned: 1 in 0.379s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aed201d-6130-4d39-aaff-a774a5de2427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead5d6505fd44dd89e5c088709d094f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:21Z,use_quota=True,user_id='93e8e588c48c439691cb81a5ea7083dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Creating volume 2aed201d-6130-4d39-aaff-a774a5de2427 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:23 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:23 devstack sudo[112698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 1073741824
Aug 26 03:22:23 devstack sudo[112698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:23 devstack sudo[112698]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 1073741824" returned: 0 in 0.556s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:23 devstack sudo[112704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427
Aug 26 03:22:23 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:23 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427" returned: 0 in 0.314s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:22:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Attempting download of 3e336504-1ee2-4368-b3a7-a31e6e325ffe ((None, [{'url': 'file:///opt/stack/data/glance/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'metadata': {}}])) to volume 2aed201d-6130-4d39-aaff-a774a5de2427. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6afe139-a38d-4951-b94f-d7caead840a1]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:24 devstack sudo[112709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz
Aug 26 03:22:24 devstack sudo[112709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:24 devstack sudo[112709]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz" returned: 0 in 0.400s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:24 devstack sudo[112713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz
Aug 26 03:22:24 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:24 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz" returned: 1 in 0.370s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e336504-1ee2-4368-b3a7-a31e6e325ffe_ea5kg_iz' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b64ce0-bcd3-4214-ace1-6a27e5631fb0]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:25 devstack sudo[112717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD
Aug 26 03:22:25 devstack sudo[112717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:25 devstack sudo[112717]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:25 devstack sudo[112721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD
Aug 26 03:22:25 devstack sudo[112721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:25 devstack sudo[112721]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:22:25 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] 3e336504-1ee2-4368-b3a7-a31e6e325ffe was raw, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:22:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:25 devstack sudo[112726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427
Aug 26 03:22:25 devstack sudo[112726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Flow 'volume_create_manager' (b0b84ae7-e5df-4e91-9a2d-28b7d66bce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:26 devstack sudo[112726]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90886ef-10e2-4f64-a060-987749776506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427" returned: 0 in 0.503s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e336504-1ee2-4368-b3a7-a31e6e325ffe_e57070o3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:22:26 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90886ef-10e2-4f64-a060-987749776506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2145110414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b0df3f-fc0f-41f0-9e32-6407cd626ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c26c9705a34f13995664f963be72bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:26Z,use_quota=True,user_id='f835c31515af419a9393a591c82a22f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7867a94-7cb1-40f9-8de3-ee1e6966bf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:26 devstack sudo[112734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 1G
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7867a94-7cb1-40f9-8de3-ee1e6966bf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:26 devstack sudo[112734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50006d6f-d50b-455f-abcd-6d371ce1eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50006d6f-d50b-455f-abcd-6d371ce1eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b0df3f-fc0f-41f0-9e32-6407cd626ea8', 'volume_name': 'volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb648137-04c4-4140-8559-de65d02a8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb648137-04c4-4140-8559-de65d02a8993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5ad70-0cb2-4096-a959-f8600ee6f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:26 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Volume 82b0df3f-fc0f-41f0-9e32-6407cd626ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8', 'volume_size': 1}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2145110414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b0df3f-fc0f-41f0-9e32-6407cd626ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c26c9705a34f13995664f963be72bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:26Z,use_quota=True,user_id='f835c31515af419a9393a591c82a22f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Creating volume 82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:26 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:26 devstack sudo[112736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 1073741824
Aug 26 03:22:26 devstack sudo[112736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:26 devstack sudo[112734]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 1G" returned: 0 in 0.391s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Downloaded image 3e336504-1ee2-4368-b3a7-a31e6e325ffe ((None, [{'url': 'file:///opt/stack/data/glance/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'metadata': {}}])) to volume 2aed201d-6130-4d39-aaff-a774a5de2427 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Temporary image 3e336504-1ee2-4368-b3a7-a31e6e325ffe for user 93e8e588c48c439691cb81a5ea7083dd is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Marking volume 2aed201d-6130-4d39-aaff-a774a5de2427 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Copying metadata from image 3e336504-1ee2-4368-b3a7-a31e6e325ffe to 2aed201d-6130-4d39-aaff-a774a5de2427. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Creating volume glance metadata for volume 2aed201d-6130-4d39-aaff-a774a5de2427 backed by image 3e336504-1ee2-4368-b3a7-a31e6e325ffe with: {'image_id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '271e0dc3c0ea65a8b1219484b4089e21', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8acc918b-bad0-4de5-bc60-cb29d99b672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aed201d-6130-4d39-aaff-a774a5de2427', 'volume_size': 1, 'image_id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '271e0dc3c0ea65a8b1219484b4089e21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ead5d6505fd44dd89e5c088709d094f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a779c7c827e55ffad276bb9618d7ac4d39c5a293fbae45707e98fa5e48914e40d8c5a858eb6dc995044ab1387ee3f991825b92288f50f4fec815c8000538a0d', 'id': '3e336504-1ee2-4368-b3a7-a31e6e325ffe', 'created_at': datetime.datetime(2026, 8, 26, 1, 22, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 22, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e336504-1ee2-4368-b3a7-a31e6e325ffe/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b89a00>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582dbcba-1309-442d-84c4-119947ff11ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:26 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Volume volume-2aed201d-6130-4d39-aaff-a774a5de2427 (2aed201d-6130-4d39-aaff-a774a5de2427): created successfully
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582dbcba-1309-442d-84c4-119947ff11ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Flow 'volume_create_manager' (45101112-a864-4625-b8e5-6acf5c253c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:26 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-14a4874c-784f-4698-8c31-0ff291938d50 tempest-VolumeImageDependencyTests-929509095 None] Created volume successfully.
Aug 26 03:22:26 devstack sudo[112736]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 1073741824" returned: 0 in 0.527s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:26 devstack sudo[112750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8
Aug 26 03:22:26 devstack sudo[112750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:27 devstack sudo[112750]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" returned: 0 in 0.283s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5ad70-0cb2-4096-a959-f8600ee6f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4725039-9ece-4976-9dc3-97462221ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:27 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Volume volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 (82b0df3f-fc0f-41f0-9e32-6407cd626ea8): created successfully
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4725039-9ece-4976-9dc3-97462221ee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Flow 'volume_create_manager' (b0b84ae7-e5df-4e91-9a2d-28b7d66bce2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ffeab3b2-2226-44e4-874b-daf225fbf110 tempest-SnapshotDependencyTests-1650993299 None] Created volume successfully.
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Acquiring lock "cinder-2aed201d-6130-4d39-aaff-a774a5de2427-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Lock "cinder-2aed201d-6130-4d39-aaff-a774a5de2427-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-55399077-5dd6-4eb6-b99c-677f9a051754 req-12474ed4-9fa1-40bd-88d6-e7daf52fb638 tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-55399077-5dd6-4eb6-b99c-677f9a051754 req-12474ed4-9fa1-40bd-88d6-e7daf52fb638 tempest-TestStampPattern-1587066898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-55399077-5dd6-4eb6-b99c-677f9a051754 req-12474ed4-9fa1-40bd-88d6-e7daf52fb638 tempest-TestStampPattern-1587066898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Acquiring lock "cinder-quobyte-2aed201d-6130-4d39-aaff-a774a5de2427" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-55399077-5dd6-4eb6-b99c-677f9a051754 req-12474ed4-9fa1-40bd-88d6-e7daf52fb638 tempest-TestStampPattern-1587066898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f5a6e8d-296b-41d8-9369-b33cc2c54b44', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Lock "cinder-quobyte-2aed201d-6130-4d39-aaff-a774a5de2427" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5fb149-74bf-4e94-af5a-76d88c987ead]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-55399077-5dd6-4eb6-b99c-677f9a051754 req-12474ed4-9fa1-40bd-88d6-e7daf52fb638 tempest-TestStampPattern-1587066898 None] attachment_update completed successfully.
Aug 26 03:22:27 devstack sudo[112761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427
Aug 26 03:22:27 devstack sudo[112761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:27 devstack sudo[112761]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427" returned: 0 in 0.381s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:27 devstack sudo[113147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427
Aug 26 03:22:27 devstack sudo[113147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:28 devstack sudo[113147]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2aed201d-6130-4d39-aaff-a774a5de2427" returned: 0 in 0.244s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Lock "cinder-quobyte-2aed201d-6130-4d39-aaff-a774a5de2427" released by "delete_volume" :: held 0.663s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Created reservations ['140b070a-4fa9-493f-8abf-dd5b5911856b', '42db208a-ce5c-4191-beab-0fd953c5164a', '736c5b42-81d8-44ab-8de9-ae03eec6729b', '5da1301a-b0e8-463b-8060-a072ab475f1f'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:28 devstack sudo[113154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:28 devstack sudo[113154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:28 devstack sudo[113154]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Deleted volume successfully.
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-9790351b-a380-47b4-9562-040aeec3ff25 tempest-VolumeImageDependencyTests-929509095 None] Lock "cinder-2aed201d-6130-4d39-aaff-a774a5de2427-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Creating offline snapshot 6d0e5729-ef49-42d8-af7e-422b0e7c950e of volume 82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf22f8b5-d2b6-4f0f-8311-4ff4f96c7331]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:28 devstack sudo[113157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8
Aug 26 03:22:28 devstack sudo[113157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:28 devstack sudo[113157]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" returned: 0 in 0.370s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:29 devstack sudo[113162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e 1G
Aug 26 03:22:29 devstack sudo[113162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:29 devstack sudo[113162]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e 1G" returned: 0 in 0.438s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:29 devstack sudo[113174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e
Aug 26 03:22:29 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:29 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:29 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e is being set with open permissions: ugo+rw
Aug 26 03:22:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:29 devstack sudo[113184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e
Aug 26 03:22:29 devstack sudo[113184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:30 devstack sudo[113184]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e" returned: 0 in 0.273s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:30 devstack sudo[113187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info
Aug 26 03:22:30 devstack sudo[113187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:30 devstack sudo[113187]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info" returned: 0 in 0.292s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:30 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info is being set with open permissions: ugo+rw
Aug 26 03:22:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:30 devstack sudo[113190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info
Aug 26 03:22:30 devstack sudo[113190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:30 devstack sudo[113190]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.info" returned: 0 in 0.277s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-dbfd9ffb-728f-4f4f-b94f-ff6cab197003 tempest-SnapshotDependencyTests-1650993299 None] Create snapshot completed successfully
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Flow 'volume_create_manager' (9e70518c-2981-493c-af1d-62ec5c56e2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f08efb4-864d-4563-b913-42e1dcfe121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f08efb4-864d-4563-b913-42e1dcfe121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b3976-2f78-4f65-89ea-a32b008fcaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c26c9705a34f13995664f963be72bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d0e5729-ef49-42d8-af7e-422b0e7c950e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:32Z,use_quota=True,user_id='f835c31515af419a9393a591c82a22f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f5a603-638e-493f-b213-b8780ee383ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f5a603-638e-493f-b213-b8780ee383ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8c80f5-4c42-48cc-9372-66e2b0b41eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8c80f5-4c42-48cc-9372-66e2b0b41eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '901b3976-2f78-4f65-89ea-a32b008fcaf0', 'volume_name': 'volume-901b3976-2f78-4f65-89ea-a32b008fcaf0', 'volume_size': 1, 'snapshot_id': '6d0e5729-ef49-42d8-af7e-422b0e7c950e'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e422ca2-4870-4b42-b567-fee34bb162b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e422ca2-4870-4b42-b567-fee34bb162b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a453dafb-b0e7-4813-95ca-3d5955c6804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Volume 901b3976-2f78-4f65-89ea-a32b008fcaf0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-901b3976-2f78-4f65-89ea-a32b008fcaf0', 'volume_size': 1, 'snapshot_id': '6d0e5729-ef49-42d8-af7e-422b0e7c950e'}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-quobyte-6d0e5729-ef49-42d8-af7e-422b0e7c950e-901b3976-2f78-4f65-89ea-a32b008fcaf0" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-6d0e5729-ef49-42d8-af7e-422b0e7c950e-901b3976-2f78-4f65-89ea-a32b008fcaf0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Creating volume 901b3976-2f78-4f65-89ea-a32b008fcaf0 from snapshot 6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-quobyte-901b3976-2f78-4f65-89ea-a32b008fcaf0" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-901b3976-2f78-4f65-89ea-a32b008fcaf0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] snapshot: 6d0e5729-ef49-42d8-af7e-422b0e7c950e, volume: 901b3976-2f78-4f65-89ea-a32b008fcaf0,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffae695a-93aa-49a7-933c-28518da61843]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:32 devstack sudo[113208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e
Aug 26 03:22:32 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-458322e2-ace7-4784-ad04-e886d97c632d req-c1f766b9-ba77-4591-a81d-ab8db6d2f132 tempest-TestStampPattern-1587066898 None] Terminate volume connection completed successfully.
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-458322e2-ace7-4784-ad04-e886d97c632d req-c1f766b9-ba77-4591-a81d-ab8db6d2f132 tempest-TestStampPattern-1587066898 None] Deleting attachment 2f5a6e8d-296b-41d8-9369-b33cc2c54b44. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:22:32 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e" returned: 0 in 0.391s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c00df-4c84-42ca-b43a-d13f04fbcc39]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:33 devstack sudo[113240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8
Aug 26 03:22:33 devstack sudo[113240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:33 devstack sudo[113240]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" returned: 0 in 0.355s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:22:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:22:33 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:22:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:33 devstack sudo[113245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0
Aug 26 03:22:33 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:37 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0" returned: 0 in 3.993s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:22:37 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Converted 1024.00 MB image at 256.41 MB/s
Aug 26 03:22:37 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 is being set with open permissions: ugo+rw
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:37 devstack sudo[113258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0
Aug 26 03:22:37 devstack sudo[113258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:37 devstack sudo[113258]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0" returned: 0 in 0.236s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-901b3976-2f78-4f65-89ea-a32b008fcaf0" released by "_copy_volume_from_snapshot" :: held 5.057s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-6d0e5729-ef49-42d8-af7e-422b0e7c950e-901b3976-2f78-4f65-89ea-a32b008fcaf0" released by "_create_volume_from_snapshot" :: held 5.124s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.144s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.036s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Creating offline snapshot f6d5435f-1c22-4262-942d-e2c4522e4423 of volume ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a453dafb-b0e7-4813-95ca-3d5955c6804d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901b3976-2f78-4f65-89ea-a32b008fcaf0', 'volume_size': 1, 'snapshot_id': '6d0e5729-ef49-42d8-af7e-422b0e7c950e'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e06ddb-8e64-49e4-b6ae-69f2371d54f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49a540-5e42-46b1-8342-bd1151b5d094]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Volume volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 (901b3976-2f78-4f65-89ea-a32b008fcaf0): created successfully
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e06ddb-8e64-49e4-b6ae-69f2371d54f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Flow 'volume_create_manager' (9e70518c-2981-493c-af1d-62ec5c56e2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a8a5f5de-e512-417a-94f5-1f43afbd9bc9 tempest-SnapshotDependencyTests-1650993299 None] Created volume successfully.
Aug 26 03:22:37 devstack sudo[113261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d
Aug 26 03:22:37 devstack sudo[113261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-6d0e5729-ef49-42d8-af7e-422b0e7c950e-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-6d0e5729-ef49-42d8-af7e-422b0e7c950e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-quobyte-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-quobyte-6d0e5729-ef49-42d8-af7e-422b0e7c950e" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-6d0e5729-ef49-42d8-af7e-422b0e7c950e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Deleting offline snapshot 6d0e5729-ef49-42d8-af7e-422b0e7c950e of volume 82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] snapshot_file for this snap is: volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a34d2-7075-489d-b7b2-c453548445ba]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:38 devstack sudo[113261]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:38 devstack sudo[113267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 1G
Aug 26 03:22:38 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:38 devstack sudo[113266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e
Aug 26 03:22:38 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:38 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e" returned: 0 in 0.368s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2924d398-aa4e-4fd6-b3a9-5e31aaf75ac1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:38 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 1G" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:38 devstack sudo[113278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423
Aug 26 03:22:38 devstack sudo[113278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:38 devstack sudo[113277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8
Aug 26 03:22:38 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:38 devstack sudo[113278]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423" returned: 0 in 0.291s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:38 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 is being set with open permissions: ugo+rw
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:38 devstack sudo[113286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423
Aug 26 03:22:38 devstack sudo[113286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:38 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" returned: 0 in 0.524s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:38 devstack sudo[113289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e
Aug 26 03:22:38 devstack sudo[113289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:38 devstack sudo[113286]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423" returned: 0 in 0.281s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:39 devstack sudo[113292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info
Aug 26 03:22:39 devstack sudo[113292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:39 devstack sudo[113289]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e" returned: 0 in 0.324s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:39 devstack sudo[113298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e
Aug 26 03:22:39 devstack sudo[113298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:39 devstack sudo[113292]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info" returned: 0 in 0.276s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:39 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info is being set with open permissions: ugo+rw
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:39 devstack sudo[113300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info
Aug 26 03:22:39 devstack sudo[113300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:39 devstack sudo[113298]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8.6d0e5729-ef49-42d8-af7e-422b0e7c950e" returned: 0 in 0.249s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-6d0e5729-ef49-42d8-af7e-422b0e7c950e" released by "_delete_snapshot" :: held 1.561s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" released by "delete_snapshot" :: held 1.584s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:39 devstack sudo[113300]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.info" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-fb022518-9a03-48e9-bd65-59af318c5ade tempest-TestStampPattern-1587066898 None] Create snapshot completed successfully
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Created reservations ['ddbb1d8c-9737-4548-93fc-6f8fccbdafac', '9d1d90e7-0d9b-4b83-9f1d-91b20cc13e48', '62384663-76f4-43c9-90c7-1dd167fc04f8', '3957931e-e146-46b8-a1a0-67f5689c4f90'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Delete snapshot completed successfully.
Aug 26 03:22:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-874a1fc6-770d-422c-99b9-a4a0c97be995 tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-6d0e5729-ef49-42d8-af7e-422b0e7c950e-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-82b0df3f-fc0f-41f0-9e32-6407cd626ea8-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-82b0df3f-fc0f-41f0-9e32-6407cd626ea8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-quobyte-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414ec83-15a4-43e6-9eda-28233127691a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:40 devstack sudo[113305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8
Aug 26 03:22:40 devstack sudo[113305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:40 devstack sudo[113305]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" returned: 0 in 0.407s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:40 devstack sudo[113310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8
Aug 26 03:22:40 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:40 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" returned: 0 in 0.258s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-82b0df3f-fc0f-41f0-9e32-6407cd626ea8" released by "delete_volume" :: held 0.736s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:40 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Created reservations ['6eef4972-2f84-4e5f-9947-56df62526c3e', '8f4a79fa-1427-4380-b501-b8e80f281532', 'cbcb03b4-8b70-44b6-8a9b-e660200c0af2', '8dfc901b-9ed9-4b10-b888-d08bfc931032'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:41 devstack sudo[113313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:41 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-901b3976-2f78-4f65-89ea-a32b008fcaf0-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:41 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.289s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-901b3976-2f78-4f65-89ea-a32b008fcaf0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Deleted volume successfully.
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c986f23-b482-49f5-9965-af6aa7cb7aab tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-82b0df3f-fc0f-41f0-9e32-6407cd626ea8-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "cinder-quobyte-901b3976-2f78-4f65-89ea-a32b008fcaf0" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-901b3976-2f78-4f65-89ea-a32b008fcaf0" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0636dfb-c458-4d82-a8dc-933216b13cc7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:41 devstack sudo[113317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0
Aug 26 03:22:41 devstack sudo[113317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:41 devstack sudo[113317]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0" returned: 0 in 0.369s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:41 devstack sudo[113331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0
Aug 26 03:22:41 devstack sudo[113331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:42 devstack sudo[113331]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-901b3976-2f78-4f65-89ea-a32b008fcaf0" returned: 0 in 0.246s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-quobyte-901b3976-2f78-4f65-89ea-a32b008fcaf0" released by "delete_volume" :: held 0.665s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Created reservations ['09e89ec9-b671-4f2f-927a-14bfe01d3874', '3628702c-fca6-44f2-8c64-584ca861a9c9', '1a316088-48bb-4a67-9c0d-ad634d31281b', '1182fd0c-c2a8-4600-aa5e-812989e98589'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:42 devstack sudo[113346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:22:42 devstack sudo[113346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:42 devstack sudo[113346]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.288s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:22:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Deleted volume successfully.
Aug 26 03:22:42 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8f37aae6-8c9a-4ca3-af3e-696de00de99f tempest-SnapshotDependencyTests-1650993299 None] Lock "cinder-901b3976-2f78-4f65-89ea-a32b008fcaf0-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Flow 'volume_create_manager' (7e66739b-d79a-4df0-ad31-7a9b38681fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60301c03-3f6e-48b0-a769-c1407890c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60301c03-3f6e-48b0-a769-c1407890c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1616239935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4f1408-c14d-4756-a068-469ea4ae01ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3406a717d2c4405f945959eabd37b0db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6d5435f-1c22-4262-942d-e2c4522e4423,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:22:47Z,use_quota=True,user_id='7574a1504b7f41079c7528e20935bfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d205a8-f967-4fbb-ba73-52670b959086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d205a8-f967-4fbb-ba73-52670b959086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9833c5-2081-4edc-a11f-6fd5d1857d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9833c5-2081-4edc-a11f-6fd5d1857d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e4f1408-c14d-4756-a068-469ea4ae01ee', 'volume_name': 'volume-7e4f1408-c14d-4756-a068-469ea4ae01ee', 'volume_size': 1, 'snapshot_id': 'f6d5435f-1c22-4262-942d-e2c4522e4423'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2aa4a6-6933-43fd-bad7-f6bdf5f3ee83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2aa4a6-6933-43fd-bad7-f6bdf5f3ee83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc0cdc4-ac91-4342-8a04-f767e6ed33be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Volume 7e4f1408-c14d-4756-a068-469ea4ae01ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e4f1408-c14d-4756-a068-469ea4ae01ee', 'volume_size': 1, 'snapshot_id': 'f6d5435f-1c22-4262-942d-e2c4522e4423'}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-quobyte-f6d5435f-1c22-4262-942d-e2c4522e4423-7e4f1408-c14d-4756-a068-469ea4ae01ee" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-f6d5435f-1c22-4262-942d-e2c4522e4423-7e4f1408-c14d-4756-a068-469ea4ae01ee" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Creating volume 7e4f1408-c14d-4756-a068-469ea4ae01ee from snapshot f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-quobyte-7e4f1408-c14d-4756-a068-469ea4ae01ee" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-7e4f1408-c14d-4756-a068-469ea4ae01ee" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] snapshot: f6d5435f-1c22-4262-942d-e2c4522e4423, volume: 7e4f1408-c14d-4756-a068-469ea4ae01ee,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f4c80-94e5-4b0e-954d-2cac6b2d58c6]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:47 devstack sudo[113402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423
Aug 26 03:22:47 devstack sudo[113402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:47 devstack sudo[113402]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423" returned: 0 in 0.366s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c065542-8b48-4e71-a182-381e2712864a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:47 devstack sudo[113407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d
Aug 26 03:22:47 devstack sudo[113407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:47 devstack sudo[113407]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d" returned: 0 in 0.385s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:22:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:47 devstack sudo[113412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee
Aug 26 03:22:47 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:54 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee" returned: 0 in 6.634s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:22:54 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Converted 1024.00 MB image at 154.33 MB/s
Aug 26 03:22:54 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee is being set with open permissions: ugo+rw
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:22:54 devstack sudo[113436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee
Aug 26 03:22:54 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:22:54 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-7e4f1408-c14d-4756-a068-469ea4ae01ee" released by "_copy_volume_from_snapshot" :: held 7.843s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-f6d5435f-1c22-4262-942d-e2c4522e4423-7e4f1408-c14d-4756-a068-469ea4ae01ee" released by "_create_volume_from_snapshot" :: held 7.919s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.941s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc0cdc4-ac91-4342-8a04-f767e6ed33be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4f1408-c14d-4756-a068-469ea4ae01ee', 'volume_size': 1, 'snapshot_id': 'f6d5435f-1c22-4262-942d-e2c4522e4423'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9f946f-3032-4417-abf9-24939742f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:22:54 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Volume volume-7e4f1408-c14d-4756-a068-469ea4ae01ee (7e4f1408-c14d-4756-a068-469ea4ae01ee): created successfully
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9f946f-3032-4417-abf9-24939742f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:22:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Flow 'volume_create_manager' (7e66739b-d79a-4df0-ad31-7a9b38681fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:22:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-08b4b9d5-231c-428c-a841-b48024b5b8ba tempest-TestStampPattern-1587066898 None] Created volume successfully.
Aug 26 03:23:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=99,cinder:SELECT=69,cinder:INSERT=30,cinder:DELETE=4 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:23:05 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=95,cinder:INSERT=25,cinder:UPDATE=94,cinder:DELETE=11 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:12 devstack sudo[113552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:23:12 devstack sudo[113552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:12 devstack sudo[113552]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.231s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:23:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:23:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9c1f430e-e110-431d-919f-f1e3a2ca0df2 req-d09f4dc5-8504-4528-8922-d23b97e72229 tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:23:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9c1f430e-e110-431d-919f-f1e3a2ca0df2 req-d09f4dc5-8504-4528-8922-d23b97e72229 tempest-TestStampPattern-1587066898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:23:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [req-9c1f430e-e110-431d-919f-f1e3a2ca0df2 req-d09f4dc5-8504-4528-8922-d23b97e72229 tempest-TestStampPattern-1587066898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:23:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-9c1f430e-e110-431d-919f-f1e3a2ca0df2 req-d09f4dc5-8504-4528-8922-d23b97e72229 tempest-TestStampPattern-1587066898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9', 'name': 'volume-7e4f1408-c14d-4756-a068-469ea4ae01ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a133543-d547-4e27-92db-38c09ee94609', 'enforce_multipath': True} {{(pid=94326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 26 03:23:39 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-9c1f430e-e110-431d-919f-f1e3a2ca0df2 req-d09f4dc5-8504-4528-8922-d23b97e72229 tempest-TestStampPattern-1587066898 None] attachment_update completed successfully.
Aug 26 03:23:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [req-21069a3c-9b88-4f94-95ed-f7066869e6b5 req-5e0d9a98-6270-4382-be8d-de68866922ea tempest-TestStampPattern-1587066898 None] Terminate volume connection completed successfully.
Aug 26 03:23:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [req-21069a3c-9b88-4f94-95ed-f7066869e6b5 req-5e0d9a98-6270-4382-be8d-de68866922ea tempest-TestStampPattern-1587066898 None] Deleting attachment 6a133543-d547-4e27-92db-38c09ee94609. {{(pid=94326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-7e4f1408-c14d-4756-a068-469ea4ae01ee-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Lock "cinder-7e4f1408-c14d-4756-a068-469ea4ae01ee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-quobyte-7e4f1408-c14d-4756-a068-469ea4ae01ee" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-7e4f1408-c14d-4756-a068-469ea4ae01ee" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[421e96ae-0a8d-4754-9b27-ec52305cc35c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:46 devstack sudo[114040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee
Aug 26 03:23:46 devstack sudo[114040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:46 devstack sudo[114040]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee" returned: 0 in 0.359s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:46 devstack sudo[114081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee
Aug 26 03:23:46 devstack sudo[114081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:47 devstack sudo[114081]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-7e4f1408-c14d-4756-a068-469ea4ae01ee" returned: 0 in 0.240s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-7e4f1408-c14d-4756-a068-469ea4ae01ee" released by "delete_volume" :: held 0.638s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Created reservations ['6a6aa0bb-9c1b-4fd6-a623-584a731a33a3', '71405ba3-5223-470d-b7d7-ced5a731968b', '9d4efff7-a3c9-4dc8-8ff8-ff84377f3f61', '7786a1c1-b29e-44d5-a80f-d0ddd4dc4185'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:47 devstack sudo[114084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:23:47 devstack sudo[114084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:47 devstack sudo[114084]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.240s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:23:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Deleted volume successfully.
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1ba8caa6-87af-4b92-b23c-c28b33b5d7ee tempest-TestStampPattern-1587066898 None] Lock "cinder-7e4f1408-c14d-4756-a068-469ea4ae01ee-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-f6d5435f-1c22-4262-942d-e2c4522e4423-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Lock "cinder-f6d5435f-1c22-4262-942d-e2c4522e4423-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-quobyte-ff8792af-3eaf-4583-9e58-b167d5e3b45d" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-ff8792af-3eaf-4583-9e58-b167d5e3b45d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-quobyte-f6d5435f-1c22-4262-942d-e2c4522e4423" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-f6d5435f-1c22-4262-942d-e2c4522e4423" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Deleting offline snapshot f6d5435f-1c22-4262-942d-e2c4522e4423 of volume ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] snapshot_file for this snap is: volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c918b142-19fa-4687-a1b3-88d5edabdc75]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:23:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:48 devstack sudo[114087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423
Aug 26 03:23:48 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:48 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:23:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03894f-3a79-47ac-a063-e19e30cf9b15]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:23:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:48 devstack sudo[114092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d
Aug 26 03:23:48 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:48 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d" returned: 0 in 0.500s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:48 devstack sudo[114097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423
Aug 26 03:23:48 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:49 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423" returned: 0 in 0.329s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:49 devstack sudo[114102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423
Aug 26 03:23:49 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:49 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d.f6d5435f-1c22-4262-942d-e2c4522e4423" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-f6d5435f-1c22-4262-942d-e2c4522e4423" released by "_delete_snapshot" :: held 1.528s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-ff8792af-3eaf-4583-9e58-b167d5e3b45d" released by "delete_snapshot" :: held 1.549s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Created reservations ['105f57ae-df85-4f80-bdd1-aada9d6be602', '7d98fd47-bb4e-419c-a67f-1be3d684cacc', 'c8ab36bf-8649-448d-8985-91b449f6ec2f', '79044ad5-ef48-486c-9c65-5abaf51083b3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:23:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Delete snapshot completed successfully.
Aug 26 03:23:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c5669e1e-78d5-4c12-ab16-a6f9f6a37ae4 tempest-TestStampPattern-1587066898 None] Lock "cinder-f6d5435f-1c22-4262-942d-e2c4522e4423-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-ff8792af-3eaf-4583-9e58-b167d5e3b45d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Lock "cinder-ff8792af-3eaf-4583-9e58-b167d5e3b45d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Acquiring lock "cinder-quobyte-ff8792af-3eaf-4583-9e58-b167d5e3b45d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-ff8792af-3eaf-4583-9e58-b167d5e3b45d" acquired by "delete_volume" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f92bb-d0ed-4225-9a41-40cb6713ec7f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:53 devstack sudo[114142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d
Aug 26 03:23:53 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:53 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d" returned: 0 in 0.337s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:53 devstack sudo[114147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d
Aug 26 03:23:53 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:54 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ff8792af-3eaf-4583-9e58-b167d5e3b45d" returned: 0 in 0.237s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Lock "cinder-quobyte-ff8792af-3eaf-4583-9e58-b167d5e3b45d" released by "delete_volume" :: held 0.626s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Created reservations ['8d6d2c69-9bc2-41db-b61f-af7244d92b5a', '6af26b55-0e5a-4895-b54b-5be85069532c', '79fdf94d-fe24-48f5-9225-465ffad81a02', 'bfb11fd0-d8c9-4251-befe-d66dfc64ec92'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:23:54 devstack sudo[114150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:23:54 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:23:54 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:23:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Deleted volume successfully.
Aug 26 03:23:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e91aa64e-b22f-41ba-813f-318b82112b48 tempest-TestStampPattern-1587066898 None] Lock "cinder-ff8792af-3eaf-4583-9e58-b167d5e3b45d-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:24:04 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Flow 'volume_create_manager' (31ec8f59-fe40-4e3e-b388-cc88be31ccfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435171b2-ee7f-4aaf-9cfa-d07be802a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435171b2-ee7f-4aaf-9cfa-d07be802a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d743dd84-bda7-4da6-a44a-ec77298a3f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368dc7f5bff244849cd427359ef942ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:09Z,use_quota=True,user_id='cf1fbf7867944eb0883944cd4b8bb7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f96d329-ba0c-47f3-afb6-696c95ea2ee5),volume_type_id=6f96d329-ba0c-47f3-afb6-696c95ea2ee5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962be684-b130-423b-b4d0-5858dba234e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962be684-b130-423b-b4d0-5858dba234e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1090b13-5de9-45a9-b6ef-f5872e306233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1090b13-5de9-45a9-b6ef-f5872e306233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd743dd84-bda7-4da6-a44a-ec77298a3f6d', 'volume_name': 'volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d', 'volume_size': 1, 'image_id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d655ef53-6995-464d-98c8-7750dad25a93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e240e70c5d579a73268c026f2ececf9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '368dc7f5bff244849cd427359ef942ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9821b791e4595d9c56ea1b7c92f1ff30e5fa913ed5155665e829d76e75477e3c3d8d930ef55dcee64e2e7dd03cd24ba68ea18dfa9f825508f2f09deffa1caf1', 'id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d655ef53-6995-464d-98c8-7750dad25a93/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b19550>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ec6549-c5fa-4814-b6f8-2789db52b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ec6549-c5fa-4814-b6f8-2789db52b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7caa00-de5f-458a-b2b9-d1a25a3cd71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Volume d743dd84-bda7-4da6-a44a-ec77298a3f6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d', 'volume_size': 1, 'image_id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d655ef53-6995-464d-98c8-7750dad25a93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e240e70c5d579a73268c026f2ececf9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '368dc7f5bff244849cd427359ef942ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9821b791e4595d9c56ea1b7c92f1ff30e5fa913ed5155665e829d76e75477e3c3d8d930ef55dcee64e2e7dd03cd24ba68ea18dfa9f825508f2f09deffa1caf1', 'id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d655ef53-6995-464d-98c8-7750dad25a93/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b19550>}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Trying to clone d743dd84-bda7-4da6-a44a-ec77298a3f6d from image d655ef53-6995-464d-98c8-7750dad25a93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d655ef53-6995-464d-98c8-7750dad25a93', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:24:09 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c123398-0f5b-4a1c-8d84-7e9ff80909f0]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:09 devstack sudo[114161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD
Aug 26 03:24:09 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:09 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD" returned: 0 in 0.327s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:09 devstack sudo[114165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD
Aug 26 03:24:09 devstack sudo[114165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:10 devstack sudo[114165]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Temporary image d655ef53-6995-464d-98c8-7750dad25a93 is fetched for user cf1fbf7867944eb0883944cd4b8bb7f0. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9505e7a-c48d-446e-8e9d-04ba7478f67c]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:10 devstack sudo[114170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD
Aug 26 03:24:10 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:10 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:10 devstack sudo[114174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD
Aug 26 03:24:10 devstack sudo[114174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:10 devstack sudo[114174]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD" returned: 1 in 0.310s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d743dd84-bda7-4da6-a44a-ec77298a3f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368dc7f5bff244849cd427359ef942ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:09Z,use_quota=True,user_id='cf1fbf7867944eb0883944cd4b8bb7f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f96d329-ba0c-47f3-afb6-696c95ea2ee5),volume_type_id=6f96d329-ba0c-47f3-afb6-696c95ea2ee5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Creating volume d743dd84-bda7-4da6-a44a-ec77298a3f6d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:10 devstack sudo[114179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d 1073741824
Aug 26 03:24:10 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:11 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d 1073741824" returned: 0 in 0.391s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:11 devstack sudo[114184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d
Aug 26 03:24:11 devstack sudo[114184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:11 devstack sudo[114184]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d" returned: 0 in 0.240s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Attempting download of d655ef53-6995-464d-98c8-7750dad25a93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d655ef53-6995-464d-98c8-7750dad25a93', 'metadata': {}}])) to volume d743dd84-bda7-4da6-a44a-ec77298a3f6d. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ef3044-53f1-4eb5-834d-03e9d34bc7ec]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:11 devstack sudo[114188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9
Aug 26 03:24:11 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:11 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:12 devstack sudo[114192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9
Aug 26 03:24:12 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:12 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9" returned: 1 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d655ef53-6995-464d-98c8-7750dad25a93_1wup71d9' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52705c6-5ffc-4c1b-a778-ec43fe0f065c]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:12 devstack sudo[114196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD
Aug 26 03:24:12 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:12 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:12 devstack sudo[114201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:12 devstack sudo[114201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:12 devstack sudo[114200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD
Aug 26 03:24:12 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:12 devstack sudo[114201]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:24:12 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD" returned: 1 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] d655ef53-6995-464d-98c8-7750dad25a93 was raw, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:24:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:12 devstack sudo[114208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d
Aug 26 03:24:12 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:13 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d" returned: 0 in 0.421s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d655ef53-6995-464d-98c8-7750dad25a93_3yezoj27devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:24:13 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:13 devstack sudo[114213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d 1G
Aug 26 03:24:13 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:13 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d 1G" returned: 0 in 0.291s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Downloaded image d655ef53-6995-464d-98c8-7750dad25a93 ((None, [{'url': 'file:///opt/stack/data/glance/images/d655ef53-6995-464d-98c8-7750dad25a93', 'metadata': {}}])) to volume d743dd84-bda7-4da6-a44a-ec77298a3f6d successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Temporary image d655ef53-6995-464d-98c8-7750dad25a93 for user cf1fbf7867944eb0883944cd4b8bb7f0 is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Marking volume d743dd84-bda7-4da6-a44a-ec77298a3f6d as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Copying metadata from image d655ef53-6995-464d-98c8-7750dad25a93 to d743dd84-bda7-4da6-a44a-ec77298a3f6d. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Creating volume glance metadata for volume d743dd84-bda7-4da6-a44a-ec77298a3f6d backed by image d655ef53-6995-464d-98c8-7750dad25a93 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9e240e70c5d579a73268c026f2ececf9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7caa00-de5f-458a-b2b9-d1a25a3cd71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d', 'volume_size': 1, 'image_id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d655ef53-6995-464d-98c8-7750dad25a93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e240e70c5d579a73268c026f2ececf9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '368dc7f5bff244849cd427359ef942ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9821b791e4595d9c56ea1b7c92f1ff30e5fa913ed5155665e829d76e75477e3c3d8d930ef55dcee64e2e7dd03cd24ba68ea18dfa9f825508f2f09deffa1caf1', 'id': 'd655ef53-6995-464d-98c8-7750dad25a93', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d655ef53-6995-464d-98c8-7750dad25a93/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b19550>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cf2933-c8f2-4af2-a08c-6c9a47ad4516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Volume volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d (d743dd84-bda7-4da6-a44a-ec77298a3f6d): created successfully
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cf2933-c8f2-4af2-a08c-6c9a47ad4516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Flow 'volume_create_manager' (31ec8f59-fe40-4e3e-b388-cc88be31ccfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ac3c1266-aefb-4a46-96d3-ced857132c60 tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Created volume successfully.
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Acquiring lock "cinder-d743dd84-bda7-4da6-a44a-ec77298a3f6d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "cinder-d743dd84-bda7-4da6-a44a-ec77298a3f6d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Acquiring lock "cinder-quobyte-d743dd84-bda7-4da6-a44a-ec77298a3f6d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "cinder-quobyte-d743dd84-bda7-4da6-a44a-ec77298a3f6d" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9237b694-98a0-408a-bff8-3f215a560eec]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:14 devstack sudo[114220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d
Aug 26 03:24:14 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:14 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d" returned: 0 in 0.353s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:14 devstack sudo[114225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d
Aug 26 03:24:14 devstack sudo[114225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:14 devstack sudo[114225]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d743dd84-bda7-4da6-a44a-ec77298a3f6d" returned: 0 in 0.234s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "cinder-quobyte-d743dd84-bda7-4da6-a44a-ec77298a3f6d" released by "delete_volume" :: held 0.624s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:15 devstack cinder-volume[94326]: WARNING cinder.quota [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:24:15 devstack cinder-volume[94326]: WARNING cinder.quota [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Created reservations ['0eed96ec-91cd-4217-aefa-1c87254d44ee', '0ab17f7a-ae5d-455e-8db9-164b59944e35', 'a6b3f83b-1f05-44a1-89a6-f8e6c9f0c479', '5fc70582-bd87-4364-89c6-021b714a7068'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:15 devstack sudo[114229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:15 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:15 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Deleted volume successfully.
Aug 26 03:24:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5de6491c-b140-43fd-873f-1aa7eec72cea tempest-VolumeAndVolumeTypeFromImageTest-731486355 None] Lock "cinder-d743dd84-bda7-4da6-a44a-ec77298a3f6d-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Flow 'volume_create_manager' (234ba291-2566-45bb-b6cb-453f6e8d2705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e23a90-de6a-4e02-85a2-e6094eac8217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e23a90-de6a-4e02-85a2-e6094eac8217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138a24f1-52cc-46ef-aa2c-90983f9bfc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7558352cec3a4b0bb4d3466b246c0d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:19Z,use_quota=True,user_id='4582385e599c432a983c04611b95c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aaeb50-e24f-47da-b613-8fa6a4f91a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aaeb50-e24f-47da-b613-8fa6a4f91a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d982a4af-2660-4759-85c0-adbe0dbfcb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d982a4af-2660-4759-85c0-adbe0dbfcb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '138a24f1-52cc-46ef-aa2c-90983f9bfc35', 'volume_name': 'volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7654aacd-1e69-42ad-bdcd-552d3e4cc637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7654aacd-1e69-42ad-bdcd-552d3e4cc637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995874f9-6efc-4894-b406-0cc72e60b705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:19 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Volume 138a24f1-52cc-46ef-aa2c-90983f9bfc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35', 'volume_size': 1}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138a24f1-52cc-46ef-aa2c-90983f9bfc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7558352cec3a4b0bb4d3466b246c0d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:19Z,use_quota=True,user_id='4582385e599c432a983c04611b95c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Creating volume 138a24f1-52cc-46ef-aa2c-90983f9bfc35 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:19 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:19 devstack sudo[114232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 1073741824
Aug 26 03:24:19 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:19 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 1073741824" returned: 0 in 0.402s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:19 devstack sudo[114238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35
Aug 26 03:24:19 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:20 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35" returned: 0 in 0.232s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995874f9-6efc-4894-b406-0cc72e60b705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bc5c0c-2509-4359-b177-7deb05836dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:20 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Volume volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 (138a24f1-52cc-46ef-aa2c-90983f9bfc35): created successfully
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bc5c0c-2509-4359-b177-7deb05836dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Flow 'volume_create_manager' (234ba291-2566-45bb-b6cb-453f6e8d2705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-31971926-e706-43ee-a073-5fe2a7895534 tempest-CinderUnicodeTest-1445417277 None] Created volume successfully.
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Flow 'volume_create_manager' (9cd96996-8253-42e3-ba3c-db98a59279b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd54aea1-282d-4c74-9a0d-50a4b883a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd54aea1-282d-4c74-9a0d-50a4b883a3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-674579557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84df8462-9d72-4d15-953a-7d0ef1aa981d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7558352cec3a4b0bb4d3466b246c0d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:21Z,use_quota=True,user_id='4582385e599c432a983c04611b95c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889136ff-c0de-46a6-b89c-a19b757634d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889136ff-c0de-46a6-b89c-a19b757634d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49d0f0-fe1a-4471-a91c-ba4de4b6d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49d0f0-fe1a-4471-a91c-ba4de4b6d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84df8462-9d72-4d15-953a-7d0ef1aa981d', 'volume_name': 'volume-84df8462-9d72-4d15-953a-7d0ef1aa981d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5af1742-a1f0-4a23-94e1-df60cf2cae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5af1742-a1f0-4a23-94e1-df60cf2cae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b96a9c-aff7-4903-b4a6-12364a9a16b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:20 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Volume 84df8462-9d72-4d15-953a-7d0ef1aa981d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84df8462-9d72-4d15-953a-7d0ef1aa981d', 'volume_size': 1}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-674579557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84df8462-9d72-4d15-953a-7d0ef1aa981d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7558352cec3a4b0bb4d3466b246c0d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:21Z,use_quota=True,user_id='4582385e599c432a983c04611b95c3e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Creating volume 84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:20 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:20 devstack sudo[114241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d 1073741824
Aug 26 03:24:20 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:21 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d 1073741824" returned: 0 in 0.378s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:21 devstack sudo[114247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d
Aug 26 03:24:21 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:21 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d" returned: 0 in 0.239s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.659s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b96a9c-aff7-4903-b4a6-12364a9a16b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84df8462-9d72-4d15-953a-7d0ef1aa981d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4c0bd2-45df-4104-aae3-de433803034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Volume volume-84df8462-9d72-4d15-953a-7d0ef1aa981d (84df8462-9d72-4d15-953a-7d0ef1aa981d): created successfully
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4c0bd2-45df-4104-aae3-de433803034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Flow 'volume_create_manager' (9cd96996-8253-42e3-ba3c-db98a59279b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-91a5169a-cf60-4826-b0ab-dbdac62370f9 tempest-CinderUnicodeTest-1445417277 None] Created volume successfully.
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Creating offline snapshot 68456712-5dad-4df7-9d39-fbca1beafdc7 of volume 84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a78166f-f6b3-40f5-b243-b31725c1c165]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:22 devstack sudo[114250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d
Aug 26 03:24:22 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:22 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d" returned: 0 in 0.337s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:22 devstack sudo[114255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 1G
Aug 26 03:24:22 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:22 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 1G" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84df8462-9d72-4d15-953a-7d0ef1aa981d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:22 devstack sudo[114260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84df8462-9d72-4d15-953a-7d0ef1aa981d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7
Aug 26 03:24:22 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:22 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84df8462-9d72-4d15-953a-7d0ef1aa981d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7" returned: 0 in 0.265s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:22 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 is being set with open permissions: ugo+rw
Aug 26 03:24:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:22 devstack sudo[114265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7
Aug 26 03:24:22 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:23 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7" returned: 0 in 0.232s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:23 devstack sudo[114268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info
Aug 26 03:24:23 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:23 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info" returned: 0 in 0.236s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:23 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info is being set with open permissions: ugo+rw
Aug 26 03:24:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:23 devstack sudo[114271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info
Aug 26 03:24:23 devstack sudo[114271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:23 devstack sudo[114271]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.info" returned: 0 in 0.242s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.751s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-99279004-c9ea-44ed-84e5-cd57f185186a tempest-CinderUnicodeTest-1445417277 None] Create snapshot completed successfully
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-68456712-5dad-4df7-9d39-fbca1beafdc7-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-68456712-5dad-4df7-9d39-fbca1beafdc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-quobyte-84df8462-9d72-4d15-953a-7d0ef1aa981d" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-84df8462-9d72-4d15-953a-7d0ef1aa981d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-quobyte-68456712-5dad-4df7-9d39-fbca1beafdc7" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-68456712-5dad-4df7-9d39-fbca1beafdc7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Deleting offline snapshot 68456712-5dad-4df7-9d39-fbca1beafdc7 of volume 84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] snapshot_file for this snap is: volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05f794-f5fd-47da-8a40-a32a827f9c0b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:24 devstack sudo[114274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7
Aug 26 03:24:24 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:24 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84df8462-9d72-4d15-953a-7d0ef1aa981d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c06327-d70e-45ac-b5b4-8a73b9e697e5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:24 devstack sudo[114279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d
Aug 26 03:24:24 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:24 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d" returned: 0 in 0.332s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:24 devstack sudo[114284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7
Aug 26 03:24:24 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:25 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7" returned: 0 in 0.317s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:25 devstack sudo[114289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7
Aug 26 03:24:25 devstack sudo[114289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:25 devstack sudo[114289]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d.68456712-5dad-4df7-9d39-fbca1beafdc7" returned: 0 in 0.233s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-68456712-5dad-4df7-9d39-fbca1beafdc7" released by "_delete_snapshot" :: held 1.319s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-84df8462-9d72-4d15-953a-7d0ef1aa981d" released by "delete_snapshot" :: held 1.339s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Created reservations ['5b243952-89e9-4212-b500-1383ee02b1be', 'b001cc9b-4030-4ecf-9c53-8c108e509483', 'ade4c2c1-f491-4b4b-839e-b57de4d3fb8e', '226494c9-bd3a-4599-b6c6-be7c08d94122'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Delete snapshot completed successfully.
Aug 26 03:24:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19e48f2e-6ea5-4de5-b99e-00df84c927f1 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-68456712-5dad-4df7-9d39-fbca1beafdc7-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-84df8462-9d72-4d15-953a-7d0ef1aa981d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-84df8462-9d72-4d15-953a-7d0ef1aa981d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-quobyte-84df8462-9d72-4d15-953a-7d0ef1aa981d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-84df8462-9d72-4d15-953a-7d0ef1aa981d" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f12ce1f-273e-4223-9eb9-8fab1156b8a2]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:26 devstack sudo[114292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d
Aug 26 03:24:26 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:26 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d" returned: 0 in 0.350s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:26 devstack sudo[114297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d
Aug 26 03:24:26 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:26 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-84df8462-9d72-4d15-953a-7d0ef1aa981d" returned: 0 in 0.234s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-84df8462-9d72-4d15-953a-7d0ef1aa981d" released by "delete_volume" :: held 0.635s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:26 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Created reservations ['b827f7bb-7498-4d9f-b69e-75f0f965b277', '123b8a60-210d-4e6c-9b49-b46f4a9a5647', '6a3e281b-e88f-4f9c-8f89-3d0da28b062e', 'ac91b3ef-bfaf-41fa-9af4-e06ad835f545'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:27 devstack sudo[114300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:27 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:27 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.231s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Deleted volume successfully.
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-60484aeb-bbce-4253-802c-d9a0a24550db tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-84df8462-9d72-4d15-953a-7d0ef1aa981d-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-138a24f1-52cc-46ef-aa2c-90983f9bfc35-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-138a24f1-52cc-46ef-aa2c-90983f9bfc35-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "cinder-quobyte-138a24f1-52cc-46ef-aa2c-90983f9bfc35" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-138a24f1-52cc-46ef-aa2c-90983f9bfc35" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f42e01-29c3-4bc5-9a01-35369cf196cf]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:27 devstack sudo[114303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35
Aug 26 03:24:27 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:27 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35" returned: 0 in 0.343s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:27 devstack sudo[114308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35
Aug 26 03:24:27 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:28 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-138a24f1-52cc-46ef-aa2c-90983f9bfc35" returned: 0 in 0.229s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-quobyte-138a24f1-52cc-46ef-aa2c-90983f9bfc35" released by "delete_volume" :: held 0.608s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Created reservations ['16d2b0c7-1425-40c9-846f-28788cbdedcd', 'c89555ff-33dc-4871-8161-16f87865e4de', 'e8a15e10-a500-4ce1-972f-869d0ba7f1b4', '75904173-5227-48b9-b7cc-b93015fa685d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:28 devstack sudo[114311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:28 devstack sudo[114311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:28 devstack sudo[114311]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.231s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Deleted volume successfully.
Aug 26 03:24:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d5048c56-869f-4506-91fd-aa0780d8b1c3 tempest-CinderUnicodeTest-1445417277 None] Lock "cinder-138a24f1-52cc-46ef-aa2c-90983f9bfc35-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=35,cinder:UPDATE=42,cinder:INSERT=17,cinder:DELETE=4 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:24:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=41,cinder:DELETE=3 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (da65cf77-a9df-4849-bc16-e846c4eab63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a381688f-9803-4df7-8c4b-17712d43ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a381688f-9803-4df7-8c4b-17712d43ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590716390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6914595a-1bcb-45a7-916e-944b8df63625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:40Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2c0a36-8b07-42cd-9197-444fa5c4af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2c0a36-8b07-42cd-9197-444fa5c4af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a4ab52-85b7-4208-827a-13177724f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a4ab52-85b7-4208-827a-13177724f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6914595a-1bcb-45a7-916e-944b8df63625', 'volume_name': 'volume-6914595a-1bcb-45a7-916e-944b8df63625', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fd4bbb-c48b-4223-aa8b-e94077decf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fd4bbb-c48b-4223-aa8b-e94077decf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c627a65-14f5-43fc-96d1-11cc99bd8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume 6914595a-1bcb-45a7-916e-944b8df63625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6914595a-1bcb-45a7-916e-944b8df63625', 'volume_size': 1}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1590716390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6914595a-1bcb-45a7-916e-944b8df63625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:40Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Creating volume 6914595a-1bcb-45a7-916e-944b8df63625 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:40 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:40 devstack sudo[114353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625 1073741824
Aug 26 03:24:40 devstack sudo[114353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (00952f4d-12af-4ca0-8eaf-71da432bc394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544ba073-ebed-4ccc-a7b8-ed1a5b43f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (a69e23a8-b000-4d4d-bd82-53439fd2f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab574e2-89be-479c-953d-af289b7be955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544ba073-ebed-4ccc-a7b8-ed1a5b43f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1400738404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f95887d-bd18-4f87-a7aa-ba6209515c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:41Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:40 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dafdcb-d9a1-4084-a1bd-95471a7f5565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dafdcb-d9a1-4084-a1bd-95471a7f5565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e17c7-b749-4c4c-a761-cf6f5246380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e17c7-b749-4c4c-a761-cf6f5246380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f95887d-bd18-4f87-a7aa-ba6209515c0b', 'volume_name': 'volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164ca3ff-4fd2-4299-89bd-01c0e6f5c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164ca3ff-4fd2-4299-89bd-01c0e6f5c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2c5072-a64d-4474-88b8-81917712e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Volume 0f95887d-bd18-4f87-a7aa-ba6209515c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b', 'volume_size': 1}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab574e2-89be-479c-953d-af289b7be955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976860572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c711c02-03a1-4f3e-a38d-f470a71ed4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:41Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b41a05-ecb5-48b6-8634-f96bde8c18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b41a05-ecb5-48b6-8634-f96bde8c18e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcb3801-a0f7-4f1a-a535-1d11e9e35c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack sudo[114353]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfcb3801-a0f7-4f1a-a535-1d11e9e35c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c711c02-03a1-4f3e-a38d-f470a71ed4ef', 'volume_name': 'volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf279af8-762f-4e68-9412-2e46e2d51828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf279af8-762f-4e68-9412-2e46e2d51828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d0ad78-67d7-43b0-ba3c-7a74c7d55d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Volume 4c711c02-03a1-4f3e-a38d-f470a71ed4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef', 'volume_size': 1}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625 1073741824" returned: 0 in 0.815s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (711869b8-5af9-4aba-a0e6-9d399489c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff44dfe6-55af-4f7c-a3ed-df91e2fca769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff44dfe6-55af-4f7c-a3ed-df91e2fca769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165418904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d514bc2d-9630-4a24-97a4-5a03581abe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:41Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8430b590-8e5f-4a4b-82ff-9d27f5e5b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8430b590-8e5f-4a4b-82ff-9d27f5e5b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79138403-a55d-4abd-8c98-5464a72e01f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79138403-a55d-4abd-8c98-5464a72e01f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd514bc2d-9630-4a24-97a4-5a03581abe6d', 'volume_name': 'volume-d514bc2d-9630-4a24-97a4-5a03581abe6d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67f92e1-64ac-4567-bb48-b874ec86b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a67f92e1-64ac-4567-bb48-b874ec86b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5552a62f-387e-464e-87ae-94a72446de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Volume d514bc2d-9630-4a24-97a4-5a03581abe6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d514bc2d-9630-4a24-97a4-5a03581abe6d', 'volume_size': 1}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:41 devstack sudo[114359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625
Aug 26 03:24:41 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (62544c71-bbf5-4aa8-8231-ac3f96b49367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3660593-4f0b-4cb6-b95f-f59d34784264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3660593-4f0b-4cb6-b95f-f59d34784264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-703379706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd40571c-4b47-4fcc-b06f-e43a18509d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:42Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedaec5b-0cbf-44c0-9551-fa089d33d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedaec5b-0cbf-44c0-9551-fa089d33d363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a5f50c-f330-44e4-9864-d86be7227a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a5f50c-f330-44e4-9864-d86be7227a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd40571c-4b47-4fcc-b06f-e43a18509d6a', 'volume_name': 'volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd73973-a13b-48f5-a63f-3e21287704fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd73973-a13b-48f5-a63f-3e21287704fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaf5559-fd8f-47d4-b9ca-7f147278cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Volume dd40571c-4b47-4fcc-b06f-e43a18509d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a', 'volume_size': 1}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1400738404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f95887d-bd18-4f87-a7aa-ba6209515c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:41Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Creating volume 0f95887d-bd18-4f87-a7aa-ba6209515c0b {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c627a65-14f5-43fc-96d1-11cc99bd8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6914595a-1bcb-45a7-916e-944b8df63625', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3071cfb9-29cf-4d02-a2bc-5d508a3d5ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:41 devstack sudo[114362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b 1073741824
Aug 26 03:24:41 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume volume-6914595a-1bcb-45a7-916e-944b8df63625 (6914595a-1bcb-45a7-916e-944b8df63625): created successfully
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3071cfb9-29cf-4d02-a2bc-5d508a3d5ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (da65cf77-a9df-4849-bc16-e846c4eab63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c821c754-8161-4529-bdab-841b56f2827f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created volume successfully.
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (a9dcb176-38fb-407e-b3d4-00905fa082f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c13e77b-d2ca-4430-b8da-38199065f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c13e77b-d2ca-4430-b8da-38199065f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104322159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:42Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a3dea7-6abd-4a4d-aa8c-d4495d630e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a3dea7-6abd-4a4d-aa8c-d4495d630e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5432ed29-909f-42c7-b774-9871ea4c51da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5432ed29-909f-42c7-b774-9871ea4c51da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44', 'volume_name': 'volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70092fdd-6a90-4d73-9c8d-01e92600a588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70092fdd-6a90-4d73-9c8d-01e92600a588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d139aa4-8f0e-4bb5-9dfa-a934f681a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Volume 1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44', 'volume_size': 1}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:42 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b 1073741824" returned: 0 in 0.566s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:42 devstack sudo[114369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b
Aug 26 03:24:42 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:42 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b" returned: 0 in 0.393s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-976860572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c711c02-03a1-4f3e-a38d-f470a71ed4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:41Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Creating volume 4c711c02-03a1-4f3e-a38d-f470a71ed4ef {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:42 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2c5072-a64d-4474-88b8-81917712e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack sudo[114372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef 1073741824
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a59d22-3d45-476b-a2fd-9516427b92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack sudo[114372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (34dff0d1-7385-4efb-a064-04bd620c9f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b24ad7-73fe-44e4-ad36-ae817a8403b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Volume volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b (0f95887d-bd18-4f87-a7aa-ba6209515c0b): created successfully
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a59d22-3d45-476b-a2fd-9516427b92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (00952f4d-12af-4ca0-8eaf-71da432bc394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b24ad7-73fe-44e4-ad36-ae817a8403b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431327042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81060c35-1be1-4ac4-9157-a82f448385a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:43Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48770ab0-c4a0-44a9-b6b6-fca1c22c524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48770ab0-c4a0-44a9-b6b6-fca1c22c524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54baf52e-5718-4670-977f-953b0c26bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54baf52e-5718-4670-977f-953b0c26bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81060c35-1be1-4ac4-9157-a82f448385a9', 'volume_name': 'volume-81060c35-1be1-4ac4-9157-a82f448385a9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c638b8c8-24df-4bc9-8a68-3c136e33eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c638b8c8-24df-4bc9-8a68-3c136e33eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e36b0b5-eca2-4235-8ed2-9e70e7ef0876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume 81060c35-1be1-4ac4-9157-a82f448385a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81060c35-1be1-4ac4-9157-a82f448385a9', 'volume_size': 1}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-414b0fd8-31e2-4f10-9e5d-b501144d4175 tempest-CreateVolumesFromImageTest-1469981444 None] Created volume successfully.
Aug 26 03:24:43 devstack sudo[114372]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef 1073741824" returned: 0 in 0.653s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (87929f38-20be-483f-932e-bbc9fb759de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264e383e-9c98-46b3-a9a6-e6714475ef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:43 devstack sudo[114377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef
Aug 26 03:24:43 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264e383e-9c98-46b3-a9a6-e6714475ef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708320058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741f220-627b-4e84-9298-5933a597257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:43Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376a2e25-8ccf-4078-86d8-eb6fc7b32331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376a2e25-8ccf-4078-86d8-eb6fc7b32331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2848e35-5bc9-46b3-98d8-8fb8449a5e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2848e35-5bc9-46b3-98d8-8fb8449a5e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3741f220-627b-4e84-9298-5933a597257e', 'volume_name': 'volume-3741f220-627b-4e84-9298-5933a597257e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3505bdc-0605-4b22-ac48-594d1ffdbe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3505bdc-0605-4b22-ac48-594d1ffdbe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f281064-8656-4a3f-9da8-19821984e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume 3741f220-627b-4e84-9298-5933a597257e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3741f220-627b-4e84-9298-5933a597257e', 'volume_size': 1}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Flow 'volume_create_manager' (3e7aca6c-3c4e-40f2-85e4-966fe539f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a92188-686f-4e97-93ce-4f25a144d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a92188-686f-4e97-93ce-4f25a144d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b5366-9232-4a83-8a74-d73c5e0ccb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2d2d34d5c34a0282d953e7393a25dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:44Z,use_quota=True,user_id='9cbb48b8a22f419eacb37f5709c05be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac672e-2567-494a-ac74-5dc57fc3e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac672e-2567-494a-ac74-5dc57fc3e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aea100d-9b0d-43f7-8cf2-47be72b91719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:24:43 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef" returned: 0 in 0.300s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.600s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165418904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d514bc2d-9630-4a24-97a4-5a03581abe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:41Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Creating volume d514bc2d-9630-4a24-97a4-5a03581abe6d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:43 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d0ad78-67d7-43b0-ba3c-7a74c7d55d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:43 devstack sudo[114380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d 1073741824
Aug 26 03:24:43 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:43 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ff9622-3ef6-4a59-ba77-c2bca714df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (2dc2c120-bcf5-4bdb-b52a-77144969e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a499a199-bd31-4924-967e-98e04fca4e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Volume volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef (4c711c02-03a1-4f3e-a38d-f470a71ed4ef): created successfully
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ff9622-3ef6-4a59-ba77-c2bca714df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (a69e23a8-b000-4d4d-bd82-53439fd2f734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a499a199-bd31-4924-967e-98e04fca4e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1915722159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fc273e-4d3b-4c85-8ac5-f2dcccc361af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:44Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994db181-c9f0-4bb6-b172-ee0f65eb3d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994db181-c9f0-4bb6-b172-ee0f65eb3d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99921ee-9e50-4e3f-b6f8-6b506d897fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99921ee-9e50-4e3f-b6f8-6b506d897fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fc273e-4d3b-4c85-8ac5-f2dcccc361af', 'volume_name': 'volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28863811-14eb-4790-850b-f9c8b1fa41ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28863811-14eb-4790-850b-f9c8b1fa41ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c07776-6237-4ff7-8b69-fa3c1e03a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume e3fc273e-4d3b-4c85-8ac5-f2dcccc361af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af', 'volume_size': 1}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f32994fa-0fac-48ec-97a4-264ce2765f3b tempest-CreateVolumesFromImageTest-1469981444 None] Created volume successfully.
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aea100d-9b0d-43f7-8cf2-47be72b91719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f03b5366-9232-4a83-8a74-d73c5e0ccb91', 'volume_name': 'volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91', 'volume_size': 1, 'image_id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce12f8634e291f862fe9eee742d0b858', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b2d2d34d5c34a0282d953e7393a25dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c865d313b76456c97f00cb936d0a1489be06372440276baaf6ed79ab06cc5e6854f8ad35a745b75216410ac9ef6f610db766f6558f5d46ba3391beb276274ae7', 'id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b883e0>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fce33d-19d5-4244-9ca0-41adedb12c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fce33d-19d5-4244-9ca0-41adedb12c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebb66ad-133e-4d82-a1d1-e16729e8268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Volume f03b5366-9232-4a83-8a74-d73c5e0ccb91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91', 'volume_size': 1, 'image_id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce12f8634e291f862fe9eee742d0b858', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b2d2d34d5c34a0282d953e7393a25dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c865d313b76456c97f00cb936d0a1489be06372440276baaf6ed79ab06cc5e6854f8ad35a745b75216410ac9ef6f610db766f6558f5d46ba3391beb276274ae7', 'id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b883e0>}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Trying to clone f03b5366-9232-4a83-8a74-d73c5e0ccb91 from image a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (5cbd0395-45eb-4051-854f-8ce9bc94a08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0cf02f-3a2e-4c30-9713-99f001372a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0cf02f-3a2e-4c30-9713-99f001372a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306493259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6603a7-e7f2-415a-91ff-0052c57ccccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:44Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708a190e-33d7-4eae-a737-68eb25d13dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708a190e-33d7-4eae-a737-68eb25d13dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62334c28-6407-40bf-9df8-faa3e33a3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62334c28-6407-40bf-9df8-faa3e33a3afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6603a7-e7f2-415a-91ff-0052c57ccccd', 'volume_name': 'volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7210a5ef-28e4-487e-b42a-695769b22a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7210a5ef-28e4-487e-b42a-695769b22a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25986e4-5779-4aab-99ee-20791426a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume 4d6603a7-e7f2-415a-91ff-0052c57ccccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd', 'volume_size': 1}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6289a536-01cd-47d6-8541-567a62ff3d5d]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:44 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d 1073741824" returned: 0 in 0.740s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:44 devstack sudo[114387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d
Aug 26 03:24:44 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:44 devstack sudo[114386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD
Aug 26 03:24:44 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (0dc4a6b4-ed98-4195-8740-1181624bd108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dc2fc3-b8d6-4a77-8238-63a84f4aed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dc2fc3-b8d6-4a77-8238-63a84f4aed13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1489951384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27809cd8-6e5b-49c9-884a-0499e5d58555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:45Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7197bfd8-7cb2-4368-8843-cf925ebdda43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7197bfd8-7cb2-4368-8843-cf925ebdda43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2941a0-8d6f-4009-8bfd-6d351aeb8dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2941a0-8d6f-4009-8bfd-6d351aeb8dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27809cd8-6e5b-49c9-884a-0499e5d58555', 'volume_name': 'volume-27809cd8-6e5b-49c9-884a-0499e5d58555', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42da169-176b-4e23-b7c8-313582332cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42da169-176b-4e23-b7c8-313582332cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b16825-d44f-44bb-9918-52a99a80e598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:44 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume 27809cd8-6e5b-49c9-884a-0499e5d58555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27809cd8-6e5b-49c9-884a-0499e5d58555', 'volume_size': 1}
Aug 26 03:24:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:45 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d" returned: 0 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:45 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.313s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-703379706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd40571c-4b47-4fcc-b06f-e43a18509d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:42Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Creating volume dd40571c-4b47-4fcc-b06f-e43a18509d6a {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:45 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5552a62f-387e-464e-87ae-94a72446de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d514bc2d-9630-4a24-97a4-5a03581abe6d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:45 devstack sudo[114393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a 1073741824
Aug 26 03:24:45 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da710c6a-ca7a-4047-9c2c-db5f68a0b45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Volume volume-d514bc2d-9630-4a24-97a4-5a03581abe6d (d514bc2d-9630-4a24-97a4-5a03581abe6d): created successfully
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da710c6a-ca7a-4047-9c2c-db5f68a0b45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (711869b8-5af9-4aba-a0e6-9d399489c29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3b5089e3-bef3-4c2e-bb5a-0e21b337d0c3 tempest-CreateVolumesFromImageTest-1469981444 None] Created volume successfully.
Aug 26 03:24:45 devstack sudo[114394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD
Aug 26 03:24:45 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Flow 'volume_create_manager' (05e06aa9-ce11-4555-aba5-57447e0f2886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69e67c3-8800-49e0-932c-e62ccf6491c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69e67c3-8800-49e0-932c-e62ccf6491c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c40cd2-8386-4122-a4be-8b73195a5254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e702eba9b2b940dabea5be99a05e36e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:45Z,use_quota=True,user_id='12bae1a5bbde49e0bdafbf313ad7f959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b066a11e-5077-445a-bbaf-31c2535564c0),volume_type_id=b066a11e-5077-445a-bbaf-31c2535564c0)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316d2eb3-5e90-4b7e-a443-86d667e2300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316d2eb3-5e90-4b7e-a443-86d667e2300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7669c17d-223e-4487-8fae-edbc228a6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.image.glance [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Creating Keystone auth plugin from conf {{(pid=94326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 26 03:24:45 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Temporary image a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 is fetched for user 9cbb48b8a22f419eacb37f5709c05be8. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49150f-bf8e-402e-b3f1-3e2fa66045b7]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7669c17d-223e-4487-8fae-edbc228a6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50c40cd2-8386-4122-a4be-8b73195a5254', 'volume_name': 'volume-50c40cd2-8386-4122-a4be-8b73195a5254', 'volume_size': 1, 'image_id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d181f354-5e13-4563-b7f4-d2285b10dfe8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1314a8bd21a91c3e05344704ced94e84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e702eba9b2b940dabea5be99a05e36e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1123726840eddb9901fae2c87d7d5c318eb4380bf9fcc88254cba55b9d8700963148db9e6eacd85819f0f878b745ac080abfb996992a032809e3ed7489792ff2', 'id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d181f354-5e13-4563-b7f4-d2285b10dfe8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0db1070>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02981b6e-1563-4b6a-b38e-1b359b310d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02981b6e-1563-4b6a-b38e-1b359b310d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c53f44-adc5-4989-9f93-573553c62e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Volume 50c40cd2-8386-4122-a4be-8b73195a5254: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50c40cd2-8386-4122-a4be-8b73195a5254', 'volume_size': 1, 'image_id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d181f354-5e13-4563-b7f4-d2285b10dfe8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1314a8bd21a91c3e05344704ced94e84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e702eba9b2b940dabea5be99a05e36e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1123726840eddb9901fae2c87d7d5c318eb4380bf9fcc88254cba55b9d8700963148db9e6eacd85819f0f878b745ac080abfb996992a032809e3ed7489792ff2', 'id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d181f354-5e13-4563-b7f4-d2285b10dfe8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0db1070>}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Trying to clone 50c40cd2-8386-4122-a4be-8b73195a5254 from image d181f354-5e13-4563-b7f4-d2285b10dfe8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d181f354-5e13-4563-b7f4-d2285b10dfe8', 'metadata': {}}]). {{(pid=94326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 26 03:24:45 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a 1073741824" returned: 0 in 0.569s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:45 devstack sudo[114405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a
Aug 26 03:24:45 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:45 devstack sudo[114403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD
Aug 26 03:24:45 devstack sudo[114403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 26 03:24:45 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Image download 0.00 MB at 0.00 MB/s
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7086d094-36f9-4f59-b99e-ccd37d171fa3]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:45 devstack sudo[114403]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:45 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:46 devstack sudo[114408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD
Aug 26 03:24:46 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a" returned: 0 in 0.304s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104322159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='336142ae7a3f425cb075a1c1a97d75b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:42Z,use_quota=True,user_id='c2b8710add704a2d92dce3e83042cbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Creating volume 1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:46 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaf5559-fd8f-47d4-b9ca-7f147278cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:46 devstack sudo[114414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 1073741824
Aug 26 03:24:46 devstack sudo[114414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96943731-8552-4e78-b7f5-be1022b4bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Volume volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a (dd40571c-4b47-4fcc-b06f-e43a18509d6a): created successfully
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96943731-8552-4e78-b7f5-be1022b4bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (62544c71-bbf5-4aa8-8231-ac3f96b49367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:46 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6fed075a-f028-4236-86b4-60ef1a3422b5 tempest-CreateVolumesFromImageTest-1469981444 None] Created volume successfully.
Aug 26 03:24:46 devstack sudo[114412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD
Aug 26 03:24:46 devstack sudo[114412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:46 devstack sudo[114412]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:46 devstack sudo[114419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD
Aug 26 03:24:46 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack sudo[114414]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 1073741824" returned: 0 in 0.462s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:46 devstack sudo[114428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44
Aug 26 03:24:46 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Temporary image d181f354-5e13-4563-b7f4-d2285b10dfe8 is fetched for user 12bae1a5bbde49e0bdafbf313ad7f959. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0087dbd-6b07-4dea-baeb-6f70d2a0ca01]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:46 devstack sudo[114433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD
Aug 26 03:24:46 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44" returned: 0 in 0.261s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.777s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431327042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81060c35-1be1-4ac4-9157-a82f448385a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:43Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Creating volume 81060c35-1be1-4ac4-9157-a82f448385a9 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:46 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d139aa4-8f0e-4bb5-9dfa-a934f681a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156c0ab5-2cdf-46a3-9096-97db36580a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:46 devstack sudo[114436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9 1073741824
Aug 26 03:24:46 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Volume volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 (1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44): created successfully
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156c0ab5-2cdf-46a3-9096-97db36580a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Flow 'volume_create_manager' (a9dcb176-38fb-407e-b3d4-00905fa082f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:46 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-50bee864-5545-42ba-ab8d-b9e4b1e4d4c2 tempest-CreateVolumesFromImageTest-1469981444 None] Created volume successfully.
Aug 26 03:24:47 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:47 devstack sudo[114454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD
Aug 26 03:24:47 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-quobyte-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd83cc9f-c430-470a-8212-55e5bd0f9c0c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:47 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9 1073741824" returned: 0 in 0.583s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:47 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:47 devstack sudo[114486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9
Aug 26 03:24:47 devstack sudo[114486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:47 devstack sudo[114480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44
Aug 26 03:24:47 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:47 devstack sudo[114486]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9" returned: 0 in 0.273s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.954s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708320058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741f220-627b-4e84-9298-5933a597257e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:43Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Creating volume 3741f220-627b-4e84-9298-5933a597257e {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:47 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:47 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:47 devstack sudo[114493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e 1073741824
Aug 26 03:24:47 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e36b0b5-eca2-4235-8ed2-9e70e7ef0876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81060c35-1be1-4ac4-9157-a82f448385a9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc5abce-af8f-4d39-9aaa-d66d4ac9d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:47 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume volume-81060c35-1be1-4ac4-9157-a82f448385a9 (81060c35-1be1-4ac4-9157-a82f448385a9): created successfully
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc5abce-af8f-4d39-9aaa-d66d4ac9d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:47 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (34dff0d1-7385-4efb-a064-04bd620c9f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:47 devstack sudo[114495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44
Aug 26 03:24:47 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-cd3a3b08-72ff-4fa8-b36a-51dd5929c6be tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created volume successfully.
Aug 26 03:24:48 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44" returned: 0 in 0.271s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44" released by "delete_volume" :: held 0.712s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Created reservations ['36e88342-c4c2-4497-9161-bde75f63f184', '585c8260-8adf-479f-8116-2035f5ef12e7', '40c07ab4-c5f6-4178-8f02-cb6c91631008', '445e6886-0077-42e7-89ff-42c2d30b3da7'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:48 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e 1073741824" returned: 0 in 0.453s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:48 devstack sudo[114502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:48 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:48 devstack sudo[114504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e
Aug 26 03:24:48 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:48 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.248s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-dd40571c-4b47-4fcc-b06f-e43a18509d6a-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Deleted volume successfully.
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-dd40571c-4b47-4fcc-b06f-e43a18509d6a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d88c8db8-f076-4848-9873-99f426625605 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-1bff1d69-4af0-4ddb-9f8a-1ce1d9a86f44-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:48 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e" returned: 0 in 0.304s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.335s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1915722159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fc273e-4d3b-4c85-8ac5-f2dcccc361af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:44Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Creating volume e3fc273e-4d3b-4c85-8ac5-f2dcccc361af {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:48 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-quobyte-dd40571c-4b47-4fcc-b06f-e43a18509d6a" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:48 devstack sudo[114508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af 1073741824
Aug 26 03:24:48 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f281064-8656-4a3f-9da8-19821984e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3741f220-627b-4e84-9298-5933a597257e', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab888e-689c-4700-974e-2ddbe4d004c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-dd40571c-4b47-4fcc-b06f-e43a18509d6a" acquired by "delete_volume" :: waited 0.041s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8967e494-1297-4b4f-a82f-64e5f22db021]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:48 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume volume-3741f220-627b-4e84-9298-5933a597257e (3741f220-627b-4e84-9298-5933a597257e): created successfully
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab888e-689c-4700-974e-2ddbe4d004c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (87929f38-20be-483f-932e-bbc9fb759de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-511a4801-37d6-4395-b789-81be36315b19 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created volume successfully.
Aug 26 03:24:48 devstack sudo[114510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a
Aug 26 03:24:48 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:48 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af 1073741824" returned: 0 in 0.421s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:48 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a" returned: 0 in 0.380s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:49 devstack sudo[114520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af
Aug 26 03:24:49 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:49 devstack sudo[114521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a
Aug 26 03:24:49 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:49 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af" returned: 0 in 0.257s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.618s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306493259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6603a7-e7f2-415a-91ff-0052c57ccccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:44Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Creating volume 4d6603a7-e7f2-415a-91ff-0052c57ccccd {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:49 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:49 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-dd40571c-4b47-4fcc-b06f-e43a18509d6a" returned: 0 in 0.279s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:49 devstack sudo[114529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd 1073741824
Aug 26 03:24:49 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c07776-6237-4ff7-8b69-fa3c1e03a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50954606-4b71-46de-876c-07c3c9fba5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-dd40571c-4b47-4fcc-b06f-e43a18509d6a" released by "delete_volume" :: held 0.720s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:49 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af (e3fc273e-4d3b-4c85-8ac5-f2dcccc361af): created successfully
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50954606-4b71-46de-876c-07c3c9fba5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (2dc2c120-bcf5-4bdb-b52a-77144969e132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d3041665-9b80-4093-9b62-c37169d7845f tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created volume successfully.
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Created reservations ['39ce6bc6-e816-4c20-8e74-f45f74443377', '4beb1762-ac00-4656-8999-91ed727722df', 'afadbac7-8fca-424a-bd61-8acdddc6057f', '90415db7-3210-481f-987a-f10b98f0537b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:49 devstack sudo[114535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:49 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-d514bc2d-9630-4a24-97a4-5a03581abe6d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-d514bc2d-9630-4a24-97a4-5a03581abe6d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-quobyte-d514bc2d-9630-4a24-97a4-5a03581abe6d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-d514bc2d-9630-4a24-97a4-5a03581abe6d" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f06afa-31d3-4579-a6e4-644dc9bcf065]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:49 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.289s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:49 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd 1073741824" returned: 0 in 0.501s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Deleted volume successfully.
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4ae7cda2-958d-4472-9cd7-7df5347dcc80 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-dd40571c-4b47-4fcc-b06f-e43a18509d6a-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:49 devstack sudo[114543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd
Aug 26 03:24:49 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:49 devstack sudo[114542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d
Aug 26 03:24:49 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:50 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.099s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1489951384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27809cd8-6e5b-49c9-884a-0499e5d58555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83b3333cac714d35b8af1a90b9049d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:45Z,use_quota=True,user_id='e1f5d3778e1e42509b3c2eb8df42e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Creating volume 27809cd8-6e5b-49c9-884a-0499e5d58555 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25986e4-5779-4aab-99ee-20791426a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:50 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:50 devstack sudo[114550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555 1073741824
Aug 26 03:24:50 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff21df2-6f54-42f7-9dc9-a5415c94378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd (4d6603a7-e7f2-415a-91ff-0052c57ccccd): created successfully
Aug 26 03:24:50 devstack sudo[114552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d
Aug 26 03:24:50 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff21df2-6f54-42f7-9dc9-a5415c94378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (5cbd0395-45eb-4051-854f-8ce9bc94a08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e3b7e36e-d3e0-43c7-bf4d-b3ce16c887f3 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created volume successfully.
Aug 26 03:24:50 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-d514bc2d-9630-4a24-97a4-5a03581abe6d" returned: 0 in 0.272s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-d514bc2d-9630-4a24-97a4-5a03581abe6d" released by "delete_volume" :: held 0.701s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Created reservations ['f8006ac8-bbd4-4d13-bee1-5f644311c248', 'd5fe70de-707c-4249-aedd-a64780b7ff3f', '4ac8ce9d-bc5d-4b21-89bd-b588d70f2c31', 'de004c55-1531-466e-b0ac-0a61a782a7a0'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:50 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555 1073741824" returned: 0 in 0.467s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:50 devstack sudo[114559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:50 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:50 devstack sudo[114561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555
Aug 26 03:24:50 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:50 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Deleted volume successfully.
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6912fe2-4ac7-4aea-9c84-fe4611de2e99 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-d514bc2d-9630-4a24-97a4-5a03581abe6d-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-4c711c02-03a1-4f3e-a38d-f470a71ed4ef-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:50 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.489s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b5366-9232-4a83-8a74-d73c5e0ccb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2d2d34d5c34a0282d953e7393a25dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:44Z,use_quota=True,user_id='9cbb48b8a22f419eacb37f5709c05be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Creating volume f03b5366-9232-4a83-8a74-d73c5e0ccb91 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b16825-d44f-44bb-9918-52a99a80e598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27809cd8-6e5b-49c9-884a-0499e5d58555', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e149085c-559e-4745-b5da-a16649c2a526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:50 devstack sudo[114565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 1073741824
Aug 26 03:24:50 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-4c711c02-03a1-4f3e-a38d-f470a71ed4ef-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Volume volume-27809cd8-6e5b-49c9-884a-0499e5d58555 (27809cd8-6e5b-49c9-884a-0499e5d58555): created successfully
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e149085c-559e-4745-b5da-a16649c2a526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Flow 'volume_create_manager' (0dc4a6b4-ed98-4195-8740-1181624bd108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-608dc990-8b1f-4cd4-9b5e-7b4a89b7b61d tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created volume successfully.
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-quobyte-4c711c02-03a1-4f3e-a38d-f470a71ed4ef" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-4c711c02-03a1-4f3e-a38d-f470a71ed4ef" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a72f55-2813-462e-80d7-d8084cbaeadc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack sudo[114567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef
Aug 26 03:24:51 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:51 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 1073741824" returned: 0 in 0.439s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack sudo[114575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91
Aug 26 03:24:51 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:51 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack sudo[114577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef
Aug 26 03:24:51 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-27809cd8-6e5b-49c9-884a-0499e5d58555-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-27809cd8-6e5b-49c9-884a-0499e5d58555-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-quobyte-27809cd8-6e5b-49c9-884a-0499e5d58555" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-27809cd8-6e5b-49c9-884a-0499e5d58555" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[93397d72-2851-427c-9c52-fcc7dd2b9cc3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.191s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c40cd2-8386-4122-a4be-8b73195a5254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e702eba9b2b940dabea5be99a05e36e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:24:45Z,use_quota=True,user_id='12bae1a5bbde49e0bdafbf313ad7f959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b066a11e-5077-445a-bbaf-31c2535564c0),volume_type_id=b066a11e-5077-445a-bbaf-31c2535564c0)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Creating volume 50c40cd2-8386-4122-a4be-8b73195a5254 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:24:51 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4c711c02-03a1-4f3e-a38d-f470a71ed4ef" returned: 0 in 0.297s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:51 devstack sudo[114582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 1073741824
Aug 26 03:24:51 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-4c711c02-03a1-4f3e-a38d-f470a71ed4ef" released by "delete_volume" :: held 0.736s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Attempting download of a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'metadata': {}}])) to volume f03b5366-9232-4a83-8a74-d73c5e0ccb91. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Created reservations ['f0ff34d3-c0a4-4ed1-be7a-9c6715a417ca', 'c31b51dc-d8b2-4d9d-a417-ecf7d2801b42', 'ab5b42b2-4fb3-4f42-9bff-27f30ef0bd4b', 'fb7718bd-c664-4074-b9c5-5535792011ff'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:51 devstack sudo[114581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555
Aug 26 03:24:51 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a9023-8a96-400c-aeb7-4ba4ce81fe48]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:51 devstack sudo[114586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:51 devstack sudo[114586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:51 devstack sudo[114585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y
Aug 26 03:24:51 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555" returned: 0 in 0.408s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack sudo[114596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555
Aug 26 03:24:52 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 1073741824" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y" returned: 0 in 0.414s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack sudo[114586]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack sudo[114601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254
Aug 26 03:24:52 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-0f95887d-bd18-4f87-a7aa-ba6209515c0b-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Deleted volume successfully.
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-83833935-15e0-421e-87aa-eb857374d85f tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-4c711c02-03a1-4f3e-a38d-f470a71ed4ef-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-0f95887d-bd18-4f87-a7aa-ba6209515c0b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:52 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "cinder-quobyte-0f95887d-bd18-4f87-a7aa-ba6209515c0b" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-27809cd8-6e5b-49c9-884a-0499e5d58555" returned: 0 in 0.317s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack sudo[114602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y
Aug 26 03:24:52 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-27809cd8-6e5b-49c9-884a-0499e5d58555" released by "delete_volume" :: held 0.779s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-0f95887d-bd18-4f87-a7aa-ba6209515c0b" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada55dbc-177c-4feb-ab43-18ac886d656d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created reservations ['b01ee734-aa21-449c-ab80-d970cd15056c', 'f3928163-58b8-447d-98dd-767249b8ccd3', '446d14d5-c610-429b-bdbb-d944d6c32d10', '65e250f7-1892-49c3-8785-67528df72c5e'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:52 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254" returned: 0 in 0.358s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Attempting download of d181f354-5e13-4563-b7f4-d2285b10dfe8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d181f354-5e13-4563-b7f4-d2285b10dfe8', 'metadata': {}}])) to volume 50c40cd2-8386-4122-a4be-8b73195a5254. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack sudo[114606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b
Aug 26 03:24:52 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack sudo[114609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:52 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd160f-180a-468c-9496-a31eb464a94d]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:52 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y" returned: 1 in 0.460s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_c5swyz7y' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c461a040-acf2-45e9-80cc-4927d7b6a026]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-4d6603a7-e7f2-415a-91ff-0052c57ccccd-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-4d6603a7-e7f2-415a-91ff-0052c57ccccd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:52 devstack sudo[114613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-quobyte-4d6603a7-e7f2-415a-91ff-0052c57ccccd" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:52 devstack sudo[114613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-4d6603a7-e7f2-415a-91ff-0052c57ccccd" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8348f27d-3bf8-412c-9926-402b4c5db806]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack sudo[114614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD
Aug 26 03:24:52 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b" returned: 0 in 0.515s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:52 devstack sudo[114622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b
Aug 26 03:24:52 devstack sudo[114622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:52 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.417s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:52 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Deleted volume successfully.
Aug 26 03:24:53 devstack sudo[114621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd
Aug 26 03:24:53 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-aa1b48db-2479-4475-9bdd-db72795e25ad tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-27809cd8-6e5b-49c9-884a-0499e5d58555-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:53 devstack sudo[114613]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj" returned: 0 in 0.494s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack sudo[114622]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0f95887d-bd18-4f87-a7aa-ba6209515c0b" returned: 0 in 0.298s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-quobyte-0f95887d-bd18-4f87-a7aa-ba6209515c0b" released by "delete_volume" :: held 0.857s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:53 devstack sudo[114628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj
Aug 26 03:24:53 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd" returned: 0 in 0.420s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Created reservations ['6b5549b5-067c-41e2-b26a-2e256ee19be9', '78ece14a-2565-409b-8f53-51d5fe52feb9', 'd1f6a314-9497-4d8b-883c-d1274cd0d857', '73a25e2b-6d2b-46cf-bd42-ea413fb76aef'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:53 devstack sudo[114631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD
Aug 26 03:24:53 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack sudo[114637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd
Aug 26 03:24:53 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack sudo[114640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:53 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj" returned: 1 in 0.452s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d181f354-5e13-4563-b7f4-d2285b10dfe8_09kv9xwj' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[41db1b0e-7a67-4e58-a122-3d043d80f43e]: (4, 'raw') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4d6603a7-e7f2-415a-91ff-0052c57ccccd" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-4d6603a7-e7f2-415a-91ff-0052c57ccccd" released by "delete_volume" :: held 0.774s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 was raw, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack sudo[114649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91
Aug 26 03:24:53 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack sudo[114645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created reservations ['cb270be5-22d1-482a-8f15-206b7ffab65c', '767d2e9f-7089-43c2-82d4-8ef0553bb711', '29a4f0bb-b949-4d85-849b-2b2c0a34fec3', 'e5ee8289-38d4-481e-8725-c0d64a8befcc'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:53 devstack sudo[114645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.320s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:53 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Deleted volume successfully.
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ee413a9-821f-48c4-a442-3526f3fa62b1 tempest-CreateVolumesFromImageTest-1469981444 None] Lock "cinder-0f95887d-bd18-4f87-a7aa-ba6209515c0b-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:53 devstack sudo[114653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:53 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-quobyte-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:54 devstack sudo[114645]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b697c-2df7-4dc6-b16f-3d0b75ed7640]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:54 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.306s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Deleted volume successfully.
Aug 26 03:24:54 devstack sudo[114660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD
Aug 26 03:24:54 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a6822d86-6941-4d2b-8925-d7086558f931 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-4d6603a7-e7f2-415a-91ff-0052c57ccccd-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:54 devstack sudo[114661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af
Aug 26 03:24:54 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:54 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91" returned: 0 in 0.597s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0_daicqgtsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:24:54 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:54 devstack sudo[114666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 1G
Aug 26 03:24:54 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:54 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] d181f354-5e13-4563-b7f4-d2285b10dfe8 was raw, converting to qcow2 {{(pid=94326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:54 devstack sudo[114674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254
Aug 26 03:24:54 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:54 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:54 devstack sudo[114676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af
Aug 26 03:24:54 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:54 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 1G" returned: 0 in 0.433s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Downloaded image a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'metadata': {}}])) to volume f03b5366-9232-4a83-8a74-d73c5e0ccb91 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Temporary image a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 for user 9cbb48b8a22f419eacb37f5709c05be8 is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Marking volume f03b5366-9232-4a83-8a74-d73c5e0ccb91 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Copying metadata from image a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 to f03b5366-9232-4a83-8a74-d73c5e0ccb91. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Creating volume glance metadata for volume f03b5366-9232-4a83-8a74-d73c5e0ccb91 backed by image a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0 with: {'image_id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ce12f8634e291f862fe9eee742d0b858', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:24:54 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af" returned: 0 in 0.336s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af" released by "delete_volume" :: held 0.788s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebb66ad-133e-4d82-a1d1-e16729e8268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91', 'volume_size': 1, 'image_id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce12f8634e291f862fe9eee742d0b858', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b2d2d34d5c34a0282d953e7393a25dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c865d313b76456c97f00cb936d0a1489be06372440276baaf6ed79ab06cc5e6854f8ad35a745b75216410ac9ef6f610db766f6558f5d46ba3391beb276274ae7', 'id': 'a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a03aa7f1-a436-49c8-b4af-2e8b00ba4fe0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0b883e0>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcad6e2-6d60-4610-a489-fb47635ccd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:54 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Volume volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 (f03b5366-9232-4a83-8a74-d73c5e0ccb91): created successfully
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcad6e2-6d60-4610-a489-fb47635ccd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Flow 'volume_create_manager' (3e7aca6c-3c4e-40f2-85e4-966fe539f216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4124787c-41a5-4996-929f-bfbfa1fd8c45 tempest-VolumeImageDependencyTests-2067647773 None] Created volume successfully.
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created reservations ['9375cb7f-3968-48d7-9d72-b1ef22a93517', 'b13e7b83-8e93-4bf1-959c-465369c7f749', 'fd187c38-9f14-400c-9884-c401449a0297', '73010e29-e8e8-4cdb-a27a-08b17791af1e'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:55 devstack sudo[114686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:55 devstack sudo[114686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:55 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254" returned: 0 in 0.626s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d181f354-5e13-4563-b7f4-d2285b10dfe8_cud84o5kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:24:55 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Converted 0.00 MB image at 0.00 MB/s
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:55 devstack sudo[114688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 1G
Aug 26 03:24:55 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-3741f220-627b-4e84-9298-5933a597257e-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-3741f220-627b-4e84-9298-5933a597257e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-quobyte-3741f220-627b-4e84-9298-5933a597257e" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-3741f220-627b-4e84-9298-5933a597257e" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590c67b-6c83-4027-abf4-6f846a78436f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:55 devstack sudo[114686]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.319s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Deleted volume successfully.
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-75b18e07-ba48-4d8a-a6cf-ee6cacd60668 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-e3fc273e-4d3b-4c85-8ac5-f2dcccc361af-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:55 devstack sudo[114691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e
Aug 26 03:24:55 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:55 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 1G" returned: 0 in 0.472s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Downloaded image d181f354-5e13-4563-b7f4-d2285b10dfe8 ((None, [{'url': 'file:///opt/stack/data/glance/images/d181f354-5e13-4563-b7f4-d2285b10dfe8', 'metadata': {}}])) to volume 50c40cd2-8386-4122-a4be-8b73195a5254 successfully. {{(pid=94326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Temporary image d181f354-5e13-4563-b7f4-d2285b10dfe8 for user 12bae1a5bbde49e0bdafbf313ad7f959 is deleted. {{(pid=94326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.volume_utils [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Marking volume 50c40cd2-8386-4122-a4be-8b73195a5254 as bootable. {{(pid=94326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Copying metadata from image d181f354-5e13-4563-b7f4-d2285b10dfe8 to 50c40cd2-8386-4122-a4be-8b73195a5254. {{(pid=94326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Creating volume glance metadata for volume 50c40cd2-8386-4122-a4be-8b73195a5254 backed by image d181f354-5e13-4563-b7f4-d2285b10dfe8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1314a8bd21a91c3e05344704ced94e84', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c53f44-adc5-4989-9f93-573553c62e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c40cd2-8386-4122-a4be-8b73195a5254', 'volume_size': 1, 'image_id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d181f354-5e13-4563-b7f4-d2285b10dfe8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1314a8bd21a91c3e05344704ced94e84', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e702eba9b2b940dabea5be99a05e36e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1123726840eddb9901fae2c87d7d5c318eb4380bf9fcc88254cba55b9d8700963148db9e6eacd85819f0f878b745ac080abfb996992a032809e3ed7489792ff2', 'id': 'd181f354-5e13-4563-b7f4-d2285b10dfe8', 'created_at': datetime.datetime(2026, 8, 26, 1, 24, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 24, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d181f354-5e13-4563-b7f4-d2285b10dfe8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7547f0db1070>}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c02aa4-ddb5-47d1-8d1c-dfca1022bd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Acquiring lock "cinder-f03b5366-9232-4a83-8a74-d73c5e0ccb91-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Lock "cinder-f03b5366-9232-4a83-8a74-d73c5e0ccb91-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Volume volume-50c40cd2-8386-4122-a4be-8b73195a5254 (50c40cd2-8386-4122-a4be-8b73195a5254): created successfully
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c02aa4-ddb5-47d1-8d1c-dfca1022bd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Flow 'volume_create_manager' (05e06aa9-ce11-4555-aba5-57447e0f2886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:24:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4b5b4bc2-61bf-4056-aeee-f3d96690e6e7 tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Created volume successfully.
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Acquiring lock "cinder-quobyte-f03b5366-9232-4a83-8a74-d73c5e0ccb91" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Lock "cinder-quobyte-f03b5366-9232-4a83-8a74-d73c5e0ccb91" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5389a8b2-0fa1-417b-969f-7ac334938208]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:55 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e" returned: 0 in 0.560s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:55 devstack sudo[114701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e
Aug 26 03:24:55 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:55 devstack sudo[114700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91
Aug 26 03:24:55 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Acquiring lock "cinder-50c40cd2-8386-4122-a4be-8b73195a5254-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "cinder-50c40cd2-8386-4122-a4be-8b73195a5254-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Acquiring lock "cinder-quobyte-50c40cd2-8386-4122-a4be-8b73195a5254" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "cinder-quobyte-50c40cd2-8386-4122-a4be-8b73195a5254" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe64c8-d794-4d40-8c55-b7ec9c8be7f0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:56 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-3741f220-627b-4e84-9298-5933a597257e" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-3741f220-627b-4e84-9298-5933a597257e" released by "delete_volume" :: held 1.018s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:56 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91" returned: 0 in 0.465s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:56 devstack sudo[114710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91
Aug 26 03:24:56 devstack sudo[114710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created reservations ['6335a9ce-07aa-4672-809b-b0014901d5c3', '5528c7a7-d817-45a5-a21b-a04fe1b69278', '6825e6ab-3584-4c25-9e18-f1afb2fa3f88', 'df1b2a9b-ab0c-479a-8479-b47168b473f4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:56 devstack sudo[114709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254
Aug 26 03:24:56 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:56 devstack sudo[114713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:56 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:56 devstack sudo[114710]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-f03b5366-9232-4a83-8a74-d73c5e0ccb91" returned: 0 in 0.347s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:56 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254" returned: 0 in 0.419s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Lock "cinder-quobyte-f03b5366-9232-4a83-8a74-d73c5e0ccb91" released by "delete_volume" :: held 0.899s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:56 devstack sudo[114719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254
Aug 26 03:24:56 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Created reservations ['aede6103-28a2-4a68-b16f-92dd4316e7c8', '1a673abf-137b-4c98-b3a2-c36e6bec238e', 'b9407753-241b-4034-8084-90f6ebca5b62', '85608304-d688-48d0-9b51-ad03f1cb8d82'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:56 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.339s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:56 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Deleted volume successfully.
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:56 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4e7e2c5d-9244-49ca-8773-60812cb54230 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-3741f220-627b-4e84-9298-5933a597257e-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:56 devstack sudo[114722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:56 devstack sudo[114722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:56 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-50c40cd2-8386-4122-a4be-8b73195a5254" returned: 0 in 0.347s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "cinder-quobyte-50c40cd2-8386-4122-a4be-8b73195a5254" released by "delete_volume" :: held 0.836s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Created reservations ['866d22ca-ae20-405e-800a-7e9b20eccbf8', '51c0c031-eb27-4c63-89b4-899194fe5f11', '6f129f3a-7f36-4daa-8391-a0863d58ee75', '593ef1d9-6794-4759-84d6-167482047482'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:57 devstack sudo[114722]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.276s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Deleted volume successfully.
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-34e70fbf-d416-4122-91b0-6ea6fca9147e tempest-VolumeImageDependencyTests-2067647773 None] Lock "cinder-f03b5366-9232-4a83-8a74-d73c5e0ccb91-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:57 devstack sudo[114726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:57 devstack sudo[114726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-81060c35-1be1-4ac4-9157-a82f448385a9-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-81060c35-1be1-4ac4-9157-a82f448385a9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:57 devstack sudo[114726]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.374s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:57 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Deleted volume successfully.
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-quobyte-81060c35-1be1-4ac4-9157-a82f448385a9" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e7755579-169b-4c37-8264-0185d417477a tempest-VolumeAndVolumeTypeFromImageTest-2141429459 None] Lock "cinder-50c40cd2-8386-4122-a4be-8b73195a5254-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-81060c35-1be1-4ac4-9157-a82f448385a9" acquired by "delete_volume" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[950975f5-2235-4b22-86d4-80fdd9dc9769]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:57 devstack sudo[114729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9
Aug 26 03:24:57 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:58 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9" returned: 0 in 0.474s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:58 devstack sudo[114735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9
Aug 26 03:24:58 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:58 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-81060c35-1be1-4ac4-9157-a82f448385a9" returned: 0 in 0.350s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-81060c35-1be1-4ac4-9157-a82f448385a9" released by "delete_volume" :: held 0.885s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created reservations ['df30e825-32e7-4f7a-94ad-7f9b27b1a287', '3e1f65ec-8041-4374-8516-29bcae33b248', 'daa3cae4-dc6a-4ac8-ab08-107dfa083ca3', '33c8fb2e-7ea3-4451-ac7c-5c024b41517b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:24:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:24:58 devstack sudo[114738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:24:58 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:24:59 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:24:59 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Deleted volume successfully.
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-62a453a5-8357-4dfa-a234-b7d3d6c03c80 tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-81060c35-1be1-4ac4-9157-a82f448385a9-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-6914595a-1bcb-45a7-916e-944b8df63625-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-6914595a-1bcb-45a7-916e-944b8df63625-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "cinder-quobyte-6914595a-1bcb-45a7-916e-944b8df63625" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-6914595a-1bcb-45a7-916e-944b8df63625" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5f67e-1a4b-42e2-b987-082632c40a39]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:24:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:00 devstack sudo[114742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625
Aug 26 03:25:00 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:00 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625" returned: 0 in 0.381s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:00 devstack sudo[114747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625
Aug 26 03:25:00 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:00 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-6914595a-1bcb-45a7-916e-944b8df63625" returned: 0 in 0.322s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-quobyte-6914595a-1bcb-45a7-916e-944b8df63625" released by "delete_volume" :: held 0.761s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Created reservations ['39745dee-5580-4dff-853c-612a200b174a', 'a767a268-748c-4d17-96fc-138355970826', '7bdbbeaf-fe9a-4ff2-8dea-8949530848e4', '459bf80c-2b0d-40d8-aecf-f975e01485e5'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:00 devstack sudo[114750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:00 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:01 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.360s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:01 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Deleted volume successfully.
Aug 26 03:25:01 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c3b15f07-d225-46a7-b359-ea19e0f57c7b tempest-CreateVolumesFromSourceVolumeTest-1119073819 None] Lock "cinder-6914595a-1bcb-45a7-916e-944b8df63625-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (d18818bd-57c5-4e9f-8d56-7c70527a1dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef30e238-0b3e-43ad-a305-9a210cf29884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef30e238-0b3e-43ad-a305-9a210cf29884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2003204144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2dc1cb-65ab-41d0-9b87-0c42f273f56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:03Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d71a681-d508-4ab2-a2f7-ad8d63abca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d71a681-d508-4ab2-a2f7-ad8d63abca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504c370b-25a2-4a23-a40e-6f31fcfd2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504c370b-25a2-4a23-a40e-6f31fcfd2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a2dc1cb-65ab-41d0-9b87-0c42f273f56c', 'volume_name': 'volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4fcbe8-81ee-40f6-bff6-c626b57f1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4fcbe8-81ee-40f6-bff6-c626b57f1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a041dfd-c403-42c8-bda2-25f3d5a50e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:03 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume 0a2dc1cb-65ab-41d0-9b87-0c42f273f56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c', 'volume_size': 1}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2003204144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2dc1cb-65ab-41d0-9b87-0c42f273f56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:03Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating volume 0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:03 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:03 devstack sudo[115086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c 1073741824
Aug 26 03:25:03 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:04 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c 1073741824" returned: 0 in 0.536s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:04 devstack sudo[115091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c
Aug 26 03:25:04 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:04 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" returned: 0 in 0.270s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a041dfd-c403-42c8-bda2-25f3d5a50e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad2f7e5-3118-4b00-b8c2-ebc79d86488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:04 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c (0a2dc1cb-65ab-41d0-9b87-0c42f273f56c): created successfully
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad2f7e5-3118-4b00-b8c2-ebc79d86488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (d18818bd-57c5-4e9f-8d56-7c70527a1dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:04 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a31c3dbe-aa5f-463a-86d7-fb2ab6be235a tempest-CreateVolumesFromSnapshotTest-599116991 None] Created volume successfully.
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Flow 'volume_create_manager' (c32fd1d7-06d7-4da2-805d-5ad15bb0005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384c5173-ab24-4441-af81-1bdb71c0774b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384c5173-ab24-4441-af81-1bdb71c0774b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-610050733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bcae4f-9d0d-4e06-aad7-7ead45c7af11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f818d61c7a4f43badbaa6ca53460fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:05Z,use_quota=True,user_id='4f92faf628af4611a6f80d1c4924f220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26f2c58-486b-4328-8cb7-4026ff613a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26f2c58-486b-4328-8cb7-4026ff613a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55957198-7c21-4dc2-804f-e78c059bd22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55957198-7c21-4dc2-804f-e78c059bd22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82bcae4f-9d0d-4e06-aad7-7ead45c7af11', 'volume_name': 'volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c78656-b1e9-425c-b4f3-40b3c6184280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c78656-b1e9-425c-b4f3-40b3c6184280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6726bc1-b600-41c2-85ab-c4e41e0b5e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Volume 82bcae4f-9d0d-4e06-aad7-7ead45c7af11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11', 'volume_size': 1}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-610050733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bcae4f-9d0d-4e06-aad7-7ead45c7af11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f818d61c7a4f43badbaa6ca53460fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:05Z,use_quota=True,user_id='4f92faf628af4611a6f80d1c4924f220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Creating volume 82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:05 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:05 devstack sudo[115095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 1073741824
Aug 26 03:25:05 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:05 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 1073741824" returned: 0 in 0.595s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:05 devstack sudo[115101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11
Aug 26 03:25:05 devstack sudo[115101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:06 devstack sudo[115101]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" returned: 0 in 0.270s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6726bc1-b600-41c2-85ab-c4e41e0b5e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0454fe-0f64-4240-887f-d3f4958342b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating offline snapshot f11c6c15-c7d7-4604-92cc-7b395923e64b of volume 0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:06 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Volume volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 (82bcae4f-9d0d-4e06-aad7-7ead45c7af11): created successfully
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0454fe-0f64-4240-887f-d3f4958342b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Flow 'volume_create_manager' (c32fd1d7-06d7-4da2-805d-5ad15bb0005d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c624b4-2f97-48d9-b193-f5f1bf659fdd]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5fcff977-3960-49be-813e-344f567d61c4 tempest-VolumeDependencyTests-90513123 None] Created volume successfully.
Aug 26 03:25:06 devstack sudo[115104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c
Aug 26 03:25:06 devstack sudo[115104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:06 devstack sudo[115104]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" returned: 0 in 0.422s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:06 devstack sudo[115109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b 1G
Aug 26 03:25:06 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:07 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b 1G" returned: 0 in 0.450s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:07 devstack sudo[115115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b
Aug 26 03:25:07 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:07 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b" returned: 0 in 0.498s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:07 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b is being set with open permissions: ugo+rw
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:07 devstack sudo[115121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b
Aug 26 03:25:07 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:07 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b" returned: 0 in 0.285s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:08 devstack sudo[115124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info
Aug 26 03:25:08 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:08 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info" returned: 0 in 0.266s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:08 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info is being set with open permissions: ugo+rw
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:08 devstack sudo[115127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info
Aug 26 03:25:08 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:08 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.info" returned: 0 in 0.260s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.931s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Creating offline snapshot 34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f of volume 82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-49be27dc-9ccc-4eab-a7b2-51fd4c1dc8f7 tempest-CreateVolumesFromSnapshotTest-599116991 None] Create snapshot completed successfully
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ecb52-ab55-436a-b57d-7b8d4ea410de]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:08 devstack sudo[115130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11
Aug 26 03:25:08 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (f45927f0-0ded-41e9-bcb9-bbe90530f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dec90e-769b-4ff1-b700-865059e478ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dec90e-769b-4ff1-b700-865059e478ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958993974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8a9801-3531-488a-b43a-1a98195c4843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:09Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5996ed97-be59-41b2-92a0-a3b8e74a6b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5996ed97-be59-41b2-92a0-a3b8e74a6b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6d3549-68df-4702-bba1-e195c0873d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6d3549-68df-4702-bba1-e195c0873d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8a9801-3531-488a-b43a-1a98195c4843', 'volume_name': 'volume-ea8a9801-3531-488a-b43a-1a98195c4843', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948286be-0fa4-410f-a3a1-ca1d296b99fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948286be-0fa4-410f-a3a1-ca1d296b99fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baf3016-679b-4e97-abfb-2564ff0b933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Volume ea8a9801-3531-488a-b43a-1a98195c4843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8a9801-3531-488a-b43a-1a98195c4843', 'volume_size': 1}
Aug 26 03:25:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:09 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" returned: 0 in 0.408s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:09 devstack sudo[115135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f 1G
Aug 26 03:25:09 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:09 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f 1G" returned: 0 in 0.482s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:09 devstack sudo[115143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f
Aug 26 03:25:09 devstack sudo[115143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (1db470fa-c736-4a37-8abd-750d44ffc1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6136486d-5095-4c75-b14a-709019dd2e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6136486d-5095-4c75-b14a-709019dd2e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841515667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492d88a0-4b15-4d81-ac81-98bca131d795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:09Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb15ef2-fe7a-446a-a6f6-cd5d4e771c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb15ef2-fe7a-446a-a6f6-cd5d4e771c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4893efd-6203-4c7b-9d35-0a672240f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4893efd-6203-4c7b-9d35-0a672240f287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492d88a0-4b15-4d81-ac81-98bca131d795', 'volume_name': 'volume-492d88a0-4b15-4d81-ac81-98bca131d795', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20415567-ff1f-4dda-b7da-fb6236aaf5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20415567-ff1f-4dda-b7da-fb6236aaf5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a746871-7996-4880-a619-8605b6d51ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume 492d88a0-4b15-4d81-ac81-98bca131d795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492d88a0-4b15-4d81-ac81-98bca131d795', 'volume_size': 1}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:09 devstack sudo[115143]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" returned: 0 in 0.383s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:09 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f is being set with open permissions: ugo+rw
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:09 devstack sudo[115148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f
Aug 26 03:25:09 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (8f65f973-81cf-4bfd-9453-3e94ff2adf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefad76f-c9ce-4a64-a569-5f6833a96e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefad76f-c9ce-4a64-a569-5f6833a96e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971164309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3fbd07-1515-4cf3-9c8a-4be74356d9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:10Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f328ab3-c86d-42c9-a845-952b75ce09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f328ab3-c86d-42c9-a845-952b75ce09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726f3647-affc-49d0-a06b-c5059739d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726f3647-affc-49d0-a06b-c5059739d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3fbd07-1515-4cf3-9c8a-4be74356d9b1', 'volume_name': 'volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff183df-33ce-45b5-bded-2888f5e46806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff183df-33ce-45b5-bded-2888f5e46806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5693729d-0ba3-44bd-a7dc-c047e088e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume 2e3fbd07-1515-4cf3-9c8a-4be74356d9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1', 'volume_size': 1}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:10 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:10 devstack sudo[115152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info
Aug 26 03:25:10 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Flow 'volume_create_manager' (e9fbbce0-289d-40f0-b92c-8ebb1ab085d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158a4fb7-2c20-42b1-9d33-05d4f6a3b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158a4fb7-2c20-42b1-9d33-05d4f6a3b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-120198382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560e82ab-cd24-4ddf-9eb6-3cde85ae4242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa1737abde3411aa5517206436865db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:10Z,use_quota=True,user_id='5d9216e1f47448138764241cb1a5f13a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67124869-6970-43ea-bfd4-a9633d4138f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67124869-6970-43ea-bfd4-a9633d4138f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfffd87-f34a-407e-832e-28169a73b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfffd87-f34a-407e-832e-28169a73b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560e82ab-cd24-4ddf-9eb6-3cde85ae4242', 'volume_name': 'volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1137e3c2-e54f-48c1-a7d6-936f9658b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1137e3c2-e54f-48c1-a7d6-936f9658b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4643704f-2015-47c6-8c42-ec63469041df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Volume 560e82ab-cd24-4ddf-9eb6-3cde85ae4242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242', 'volume_size': 1}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info" returned: 0 in 0.307s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:10 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info is being set with open permissions: ugo+rw
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:10 devstack sudo[115155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info
Aug 26 03:25:10 devstack sudo[115155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (3160f6d6-fff3-4d67-a756-02517755945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f170cf-93ca-4e28-8da4-971de4ca22f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f170cf-93ca-4e28-8da4-971de4ca22f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622158685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a50793a-c1f4-4062-b6a1-e6755ba845bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:10Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1f758-2e7a-44ae-b712-c774114d2b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1f758-2e7a-44ae-b712-c774114d2b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c294754-c5bc-40a6-9bc4-d409b9e0c9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c294754-c5bc-40a6-9bc4-d409b9e0c9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a50793a-c1f4-4062-b6a1-e6755ba845bb', 'volume_name': 'volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471d5a73-3cc5-4831-b70c-42917eb7054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471d5a73-3cc5-4831-b70c-42917eb7054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94859492-80b9-4864-8c66-f850e063e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume 0a50793a-c1f4-4062-b6a1-e6755ba845bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb', 'volume_size': 1}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (0cff1bf0-33b6-4344-bedc-692b19f9caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f091145-d2a5-49c6-bc96-eddba98a3d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f091145-d2a5-49c6-bc96-eddba98a3d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996688433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a649fa9-80bd-438b-ada9-ac7f4f0cc79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:11Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bcb20f-d722-4da8-950b-2767ac68f73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bcb20f-d722-4da8-950b-2767ac68f73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c84ddc-8331-4013-905b-f7719488befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c84ddc-8331-4013-905b-f7719488befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a649fa9-80bd-438b-ada9-ac7f4f0cc79c', 'volume_name': 'volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cfbf55-6f73-4a0c-88eb-17e38b333547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cfbf55-6f73-4a0c-88eb-17e38b333547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aefcbdf-7f47-4f16-aae6-5c2c172a54d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume 2a649fa9-80bd-438b-ada9-ac7f4f0cc79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c', 'volume_size': 1}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:10 devstack sudo[115155]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.info" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.050s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958993974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8a9801-3531-488a-b43a-1a98195c4843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:09Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Creating volume ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:10 devstack sudo[115158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 1073741824
Aug 26 03:25:10 devstack sudo[115158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0e67e128-a385-4456-a7a7-758c76489ada tempest-VolumeDependencyTests-90513123 None] Create snapshot completed successfully
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (302bf93f-0f5d-4e00-a861-42e50d4d49de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24e2b25-3527-4f89-8d03-fffe642d1ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24e2b25-3527-4f89-8d03-fffe642d1ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557325930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d2ba5c-a12a-44a6-a76d-c729c77d7860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:11Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3e5c7e-aa89-4bc4-80b8-540dfb337c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3e5c7e-aa89-4bc4-80b8-540dfb337c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4858341-43a4-4004-90c8-c8fb30a36f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4858341-43a4-4004-90c8-c8fb30a36f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d2ba5c-a12a-44a6-a76d-c729c77d7860', 'volume_name': 'volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40e7294-42f9-446d-a5c3-6d219ef7ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40e7294-42f9-446d-a5c3-6d219ef7ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fd951c-cf0c-4031-954f-9b5a2f108caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume c2d2ba5c-a12a-44a6-a76d-c729c77d7860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860', 'volume_size': 1}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:11 devstack sudo[115158]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 1073741824" returned: 0 in 0.445s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:11 devstack sudo[115164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843
Aug 26 03:25:11 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:11 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843" returned: 0 in 0.265s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841515667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492d88a0-4b15-4d81-ac81-98bca131d795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:09Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating volume 492d88a0-4b15-4d81-ac81-98bca131d795 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:11 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baf3016-679b-4e97-abfb-2564ff0b933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8a9801-3531-488a-b43a-1a98195c4843', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:11 devstack sudo[115167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795 1073741824
Aug 26 03:25:11 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138de013-4dda-494c-83d3-5fbd0b3fdad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Volume volume-ea8a9801-3531-488a-b43a-1a98195c4843 (ea8a9801-3531-488a-b43a-1a98195c4843): created successfully
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138de013-4dda-494c-83d3-5fbd0b3fdad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (f45927f0-0ded-41e9-bcb9-bbe90530f081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-49aff2d2-e320-4ca1-a005-aca69ddfe500 tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:25:12 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795 1073741824" returned: 0 in 0.479s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:12 devstack sudo[115173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795
Aug 26 03:25:12 devstack sudo[115173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:12 devstack sudo[115173]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795" returned: 0 in 0.331s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971164309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e3fbd07-1515-4cf3-9c8a-4be74356d9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:10Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating volume 2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:12 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:12 devstack sudo[115264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 1073741824
Aug 26 03:25:12 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a746871-7996-4880-a619-8605b6d51ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492d88a0-4b15-4d81-ac81-98bca131d795', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235eec27-fc43-4461-a8e9-d02eb8f316b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:12 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume volume-492d88a0-4b15-4d81-ac81-98bca131d795 (492d88a0-4b15-4d81-ac81-98bca131d795): created successfully
Aug 26 03:25:12 devstack sudo[115266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:12 devstack sudo[115266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235eec27-fc43-4461-a8e9-d02eb8f316b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (1db470fa-c736-4a37-8abd-750d44ffc1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f92950ee-fc91-4dde-879b-d9944f83a865 tempest-CreateVolumesFromSnapshotTest-599116991 None] Created volume successfully.
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Flow 'volume_create_manager' (a92558a1-5197-44b7-91a3-1181552d6ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb5074c-5b50-47c3-a8a6-3a4201d3e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb5074c-5b50-47c3-a8a6-3a4201d3e43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1442275349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86cfeada-9993-4cb3-bd04-54274501d2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f818d61c7a4f43badbaa6ca53460fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:13Z,use_quota=True,user_id='4f92faf628af4611a6f80d1c4924f220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f7936b-196f-42f5-9f0d-423da4dc3172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f7936b-196f-42f5-9f0d-423da4dc3172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acda0e9a-1bc7-4f81-b33f-38c0d0db205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acda0e9a-1bc7-4f81-b33f-38c0d0db205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86cfeada-9993-4cb3-bd04-54274501d2a5', 'volume_name': 'volume-86cfeada-9993-4cb3-bd04-54274501d2a5', 'volume_size': 1, 'snapshot_id': '34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2924afd-97e7-4943-8fa8-07be600ae8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2924afd-97e7-4943-8fa8-07be600ae8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ee1e5e-4af6-42ee-86f2-26a4715782b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:12 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Volume 86cfeada-9993-4cb3-bd04-54274501d2a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86cfeada-9993-4cb3-bd04-54274501d2a5', 'volume_size': 1, 'snapshot_id': '34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f'}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:12 devstack sudo[115266]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.280s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:25:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:25:13 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 1073741824" returned: 0 in 0.453s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:13 devstack sudo[115273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1
Aug 26 03:25:13 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:13 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1" returned: 0 in 0.236s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-120198382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560e82ab-cd24-4ddf-9eb6-3cde85ae4242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa1737abde3411aa5517206436865db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:10Z,use_quota=True,user_id='5d9216e1f47448138764241cb1a5f13a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Creating volume 560e82ab-cd24-4ddf-9eb6-3cde85ae4242 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:13 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5693729d-0ba3-44bd-a7dc-c047e088e294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8ea68b-b550-471f-ab30-355a51678e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:13 devstack sudo[115276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 1073741824
Aug 26 03:25:13 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:13 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 (2e3fbd07-1515-4cf3-9c8a-4be74356d9b1): created successfully
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8ea68b-b550-471f-ab30-355a51678e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (8f65f973-81cf-4bfd-9453-3e94ff2adf82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ac1b7b47-118b-455c-9af2-96c3bbac94fb tempest-CreateVolumesFromSnapshotTest-599116991 None] Created volume successfully.
Aug 26 03:25:13 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 1073741824" returned: 0 in 0.463s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:13 devstack sudo[115282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242
Aug 26 03:25:13 devstack sudo[115282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:14 devstack sudo[115282]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242" returned: 0 in 0.244s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.316s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-622158685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a50793a-c1f4-4062-b6a1-e6755ba845bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:10Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating volume 0a50793a-c1f4-4062-b6a1-e6755ba845bb {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:14 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4643704f-2015-47c6-8c42-ec63469041df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:14 devstack sudo[115285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb 1073741824
Aug 26 03:25:14 devstack sudo[115285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93cf1bf-259b-484c-8838-3c315aab8865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Volume volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 (560e82ab-cd24-4ddf-9eb6-3cde85ae4242): created successfully
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93cf1bf-259b-484c-8838-3c315aab8865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Flow 'volume_create_manager' (e9fbbce0-289d-40f0-b92c-8ebb1ab085d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-217a89fa-ee78-4427-911f-ce13277ca8da tempest-ProjectReaderTests-2003765347 None] Created volume successfully.
Aug 26 03:25:14 devstack sudo[115285]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb 1073741824" returned: 0 in 0.409s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:14 devstack sudo[115292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb
Aug 26 03:25:14 devstack sudo[115292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:14 devstack sudo[115292]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb" returned: 0 in 0.267s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.909s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996688433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a649fa9-80bd-438b-ada9-ac7f4f0cc79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:11Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating volume 2a649fa9-80bd-438b-ada9-ac7f4f0cc79c {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:14 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:14 devstack sudo[115295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c 1073741824
Aug 26 03:25:14 devstack sudo[115295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94859492-80b9-4864-8c66-f850e063e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6c60fd-ac61-412a-a56a-083215868830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb (0a50793a-c1f4-4062-b6a1-e6755ba845bb): created successfully
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6c60fd-ac61-412a-a56a-083215868830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (3160f6d6-fff3-4d67-a756-02517755945d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:14 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-96c9ea71-3476-41b7-a78e-81c9e86d233d tempest-CreateVolumesFromSnapshotTest-599116991 None] Created volume successfully.
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "cinder-560e82ab-cd24-4ddf-9eb6-3cde85ae4242-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-560e82ab-cd24-4ddf-9eb6-3cde85ae4242-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "cinder-quobyte-560e82ab-cd24-4ddf-9eb6-3cde85ae4242" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-quobyte-560e82ab-cd24-4ddf-9eb6-3cde85ae4242" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ee2d51-548a-49e4-96eb-6a633b722f71]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:15 devstack sudo[115299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242
Aug 26 03:25:15 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:15 devstack sudo[115295]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c 1073741824" returned: 0 in 0.435s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:15 devstack sudo[115303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c
Aug 26 03:25:15 devstack sudo[115303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:15 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242" returned: 0 in 0.375s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:15 devstack sudo[115308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242
Aug 26 03:25:15 devstack sudo[115308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:15 devstack sudo[115303]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c" returned: 0 in 0.273s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.278s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557325930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d2ba5c-a12a-44a6-a76d-c729c77d7860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e3278f324d4255b6f0368eed82b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:11Z,use_quota=True,user_id='72d0e96e728e4e12861a5d2399030594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Creating volume c2d2ba5c-a12a-44a6-a76d-c729c77d7860 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:15 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aefcbdf-7f47-4f16-aae6-5c2c172a54d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c41c970-bb5b-4530-ba63-d08be79abf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:15 devstack sudo[115311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 1073741824
Aug 26 03:25:15 devstack sudo[115311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:15 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c (2a649fa9-80bd-438b-ada9-ac7f4f0cc79c): created successfully
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c41c970-bb5b-4530-ba63-d08be79abf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (0cff1bf0-33b6-4344-bedc-692b19f9caf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c6be42b2-d34a-4641-a8bd-3df7ad372724 tempest-CreateVolumesFromSnapshotTest-599116991 None] Created volume successfully.
Aug 26 03:25:15 devstack sudo[115308]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-560e82ab-cd24-4ddf-9eb6-3cde85ae4242" returned: 0 in 0.292s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-quobyte-560e82ab-cd24-4ddf-9eb6-3cde85ae4242" released by "delete_volume" :: held 0.715s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Created reservations ['5c788af6-f636-417e-af91-15e56d9ba51c', '10120dec-721f-4b75-87a3-6f1b51855204', '69be0a91-9d84-4efc-ad83-85dfea3e2f7f', '544cd1f4-dc51-406e-986e-8204464d0019'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:15 devstack sudo[115317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:15 devstack sudo[115317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:15 devstack sudo[115311]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 1073741824" returned: 0 in 0.455s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:16 devstack sudo[115319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860
Aug 26 03:25:16 devstack sudo[115319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:16 devstack sudo[115317]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.271s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Deleted volume successfully.
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-77692e25-9a64-49ea-bdc5-22c09d771ff2 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-560e82ab-cd24-4ddf-9eb6-3cde85ae4242-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:16 devstack sudo[115319]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860" returned: 0 in 0.265s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.622s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fd951c-cf0c-4031-954f-9b5a2f108caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7645b37-784f-477c-b40d-2660b7974173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot e91e5380-4fe6-4f3b-9431-969ec8d2d244 of volume ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Volume volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 (c2d2ba5c-a12a-44a6-a76d-c729c77d7860): created successfully
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7645b37-784f-477c-b40d-2660b7974173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Flow 'volume_create_manager' (302bf93f-0f5d-4e00-a861-42e50d4d49de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1185e5fc-2fad-445d-af43-999d428cb5a6]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-68d4eabd-6a89-431f-83d6-6d25ee3d2a9a tempest-CreateVolumesFromSnapshotTest-599116991 None] Created volume successfully.
Aug 26 03:25:16 devstack sudo[115323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843
Aug 26 03:25:16 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Flow 'volume_create_manager' (4d356695-a111-4c63-9cfb-1239d44cae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f817762-61b5-49d9-bd90-8dc7c3c9681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f817762-61b5-49d9-bd90-8dc7c3c9681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997086205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bc353c-720a-4bc0-8b51-013edb6496e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa1737abde3411aa5517206436865db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:16Z,use_quota=True,user_id='5d9216e1f47448138764241cb1a5f13a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9a4a0c-5d93-4c6b-b7d9-e325a05c47e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9a4a0c-5d93-4c6b-b7d9-e325a05c47e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde972be-67f0-41de-b061-220d4db99352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde972be-67f0-41de-b061-220d4db99352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bc353c-720a-4bc0-8b51-013edb6496e9', 'volume_name': 'volume-47bc353c-720a-4bc0-8b51-013edb6496e9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5e4fb4-2882-4c2d-95e9-500314a7b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5e4fb4-2882-4c2d-95e9-500314a7b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8b9763-f592-4e3f-a717-a495d98eb078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Volume 47bc353c-720a-4bc0-8b51-013edb6496e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bc353c-720a-4bc0-8b51-013edb6496e9', 'volume_size': 1}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:16 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:16 devstack sudo[115328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 1G
Aug 26 03:25:16 devstack sudo[115328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-c2d2ba5c-a12a-44a6-a76d-c729c77d7860-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-c2d2ba5c-a12a-44a6-a76d-c729c77d7860-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-c2d2ba5c-a12a-44a6-a76d-c729c77d7860" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-c2d2ba5c-a12a-44a6-a76d-c729c77d7860" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3b86e-645d-417e-aa8f-f65f2c8fea61]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:17 devstack sudo[115328]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 1G" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8a9801-3531-488a-b43a-1a98195c4843 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:17 devstack sudo[115335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8a9801-3531-488a-b43a-1a98195c4843 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244
Aug 26 03:25:17 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:17 devstack sudo[115333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860
Aug 26 03:25:17 devstack sudo[115333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:17 devstack sudo[115333]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860" returned: 0 in 0.372s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:17 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8a9801-3531-488a-b43a-1a98195c4843 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:17 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 is being set with open permissions: ugo+rw
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:17 devstack sudo[115344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860
Aug 26 03:25:17 devstack sudo[115344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:17 devstack sudo[115345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244
Aug 26 03:25:17 devstack sudo[115345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:17 devstack sudo[115344]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c2d2ba5c-a12a-44a6-a76d-c729c77d7860" returned: 0 in 0.254s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:17 devstack sudo[115345]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244" returned: 0 in 0.253s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-c2d2ba5c-a12a-44a6-a76d-c729c77d7860" released by "delete_volume" :: held 0.669s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:17 devstack sudo[115350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info
Aug 26 03:25:17 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['415522ea-0943-4af4-8330-c474b0f2e566', '70f82a43-e149-49ca-a3a3-1c535ead896f', '15b3928a-b431-415f-a549-182b2167b299', '1b7bafce-3a8a-4dfb-aa91-9172dcf45dd0'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:17 devstack sudo[115352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:17 devstack sudo[115352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:18 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info" returned: 0 in 0.246s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:18 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info is being set with open permissions: ugo+rw
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:18 devstack sudo[115355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info
Aug 26 03:25:18 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:18 devstack sudo[115352]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleted volume successfully.
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f98a6638-d4e2-415e-a4fd-9d07c799573a tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-c2d2ba5c-a12a-44a6-a76d-c729c77d7860-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[beabe3f0-36fc-488d-be4d-84e3f310b517]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:18 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.info" returned: 0 in 0.261s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.480s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-quobyte-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f-86cfeada-9993-4cb3-bd04-54274501d2a5" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f-86cfeada-9993-4cb3-bd04-54274501d2a5" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Creating volume 86cfeada-9993-4cb3-bd04-54274501d2a5 from snapshot 34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-quobyte-86cfeada-9993-4cb3-bd04-54274501d2a5" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-612aa9ac-f6b7-4572-9e6e-09276232b4b0 tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:25:18 devstack sudo[115359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c
Aug 26 03:25:18 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-86cfeada-9993-4cb3-bd04-54274501d2a5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] snapshot: 34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f, volume: 86cfeada-9993-4cb3-bd04-54274501d2a5,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c4d44-d0f7-466d-8510-a58d628055ed]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:18 devstack sudo[115361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f
Aug 26 03:25:18 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:18 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c" returned: 0 in 0.389s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:18 devstack sudo[115366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c
Aug 26 03:25:18 devstack sudo[115366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:18 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-e91e5380-4fe6-4f3b-9431-969ec8d2d244-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Lock "cinder-e91e5380-4fe6-4f3b-9431-969ec8d2d244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-ea8a9801-3531-488a-b43a-1a98195c4843" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b13cbe-6aa3-47ef-9ec7-2072683b2454]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-ea8a9801-3531-488a-b43a-1a98195c4843" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-e91e5380-4fe6-4f3b-9431-969ec8d2d244" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-e91e5380-4fe6-4f3b-9431-969ec8d2d244" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot e91e5380-4fe6-4f3b-9431-969ec8d2d244 of volume ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:18 devstack sudo[115366]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c646435-8623-4969-b23d-8d73749dbd5f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c" returned: 0 in 0.297s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c" released by "delete_volume" :: held 0.729s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:18 devstack sudo[115371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11
Aug 26 03:25:18 devstack sudo[115371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['0f3d3cf5-f437-4341-b892-3dc9f86ba708', '0428c146-d763-4ee2-86a3-3958b6c5b4e4', '1ab0df22-9fa1-40c7-b715-3ffe78fe3eb8', '1cc1b1c1-bd24-4821-95d4-240291d3cffa'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:19 devstack sudo[115373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244
Aug 26 03:25:19 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:19 devstack sudo[115376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:19 devstack sudo[115376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:19 devstack sudo[115371]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:19 devstack sudo[115381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5
Aug 26 03:25:19 devstack sudo[115381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-0a50793a-c1f4-4062-b6a1-e6755ba845bb-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.262s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:19 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleted volume successfully.
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-0a50793a-c1f4-4062-b6a1-e6755ba845bb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-edb019ef-f640-495d-bcd6-46a65865aa35 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-2a649fa9-80bd-438b-ada9-ac7f4f0cc79c-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244" returned: 0 in 0.487s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8a9801-3531-488a-b43a-1a98195c4843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:19 devstack sudo[115376]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:19 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-0a50793a-c1f4-4062-b6a1-e6755ba845bb" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6527d9ae-60e3-479f-a07d-5da8a7226bc5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-0a50793a-c1f4-4062-b6a1-e6755ba845bb" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412be89-3dc1-4524-9ab0-41bc3a1bf13e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:19 devstack sudo[115390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843
Aug 26 03:25:19 devstack sudo[115390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:19 devstack sudo[115391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb
Aug 26 03:25:19 devstack sudo[115391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:20 devstack sudo[115391]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:20 devstack sudo[115390]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843" returned: 0 in 0.588s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb" returned: 0 in 0.553s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:20 devstack sudo[115410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244
Aug 26 03:25:20 devstack sudo[115410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:20 devstack sudo[115411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb
Aug 26 03:25:20 devstack sudo[115411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:20 devstack sudo[115411]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a50793a-c1f4-4062-b6a1-e6755ba845bb" returned: 0 in 0.465s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-0a50793a-c1f4-4062-b6a1-e6755ba845bb" released by "delete_volume" :: held 1.084s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['e7a889e5-5183-447e-a4a5-c10263d1fd65', '8fdfa385-bcb8-4fde-b9ca-9053a416c48a', '1b8101b0-1d61-4085-9d62-795e1094f170', '281d7eae-fd33-48f8-b65f-0e948b112470'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:20 devstack sudo[115419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:20 devstack sudo[115419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:21 devstack sudo[115410]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244" returned: 0 in 0.978s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:21 devstack sudo[115421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244
Aug 26 03:25:21 devstack sudo[115421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:21 devstack sudo[115419]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.548s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleted volume successfully.
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-a0baa3df-908c-48d8-84ad-cc2227477135 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-0a50793a-c1f4-4062-b6a1-e6755ba845bb-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:21 devstack sudo[115421]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843.e91e5380-4fe6-4f3b-9431-969ec8d2d244" returned: 0 in 0.547s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-e91e5380-4fe6-4f3b-9431-969ec8d2d244" released by "_delete_snapshot" :: held 2.792s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-ea8a9801-3531-488a-b43a-1a98195c4843" released by "delete_snapshot" :: held 2.835s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Created reservations ['6b4eb565-1cf2-416d-997c-692a3faaf7da', '45a83fe4-aac6-4f29-b4be-798deb5fcda7', 'e60230a9-f1eb-45e7-9522-b5c72d54866c', '461babba-70f5-47d0-9b38-9ff1a50d17b9'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1" acquired by "delete_volume" :: waited 0.049s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8f56f-c1fe-4282-869f-1dd19142c19d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:22 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e88d87f-c076-494b-aef6-c59ca07c09aa tempest-ProjectMemberTests-1509217531 None] Lock "cinder-e91e5380-4fe6-4f3b-9431-969ec8d2d244-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-ea8a9801-3531-488a-b43a-1a98195c4843-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Lock "cinder-ea8a9801-3531-488a-b43a-1a98195c4843-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:22 devstack sudo[115425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1
Aug 26 03:25:22 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-ea8a9801-3531-488a-b43a-1a98195c4843" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-ea8a9801-3531-488a-b43a-1a98195c4843" acquired by "delete_volume" :: waited 0.060s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac23a4a0-4f25-455f-8645-759153ee1ce3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:23 devstack sudo[115427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843
Aug 26 03:25:23 devstack sudo[115427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:23 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1" returned: 0 in 1.146s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:23 devstack sudo[115432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1
Aug 26 03:25:23 devstack sudo[115432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:23 devstack sudo[115427]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843" returned: 0 in 0.855s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:23 devstack sudo[115437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843
Aug 26 03:25:23 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:23 devstack sudo[115432]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1" returned: 0 in 0.582s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:23 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1" released by "delete_volume" :: held 1.853s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['dcaec9a9-c950-46ff-b1aa-963ad4f0257f', 'd397f36d-0f3a-4f6d-9012-68f7d271fd3d', 'e8d5f7ee-f495-40e8-a646-bcd38164b3e4', '060f614d-10fa-4de8-b7c7-307ab9377ae2'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:24 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ea8a9801-3531-488a-b43a-1a98195c4843" returned: 0 in 0.656s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:24 devstack sudo[115441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:24 devstack sudo[115441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-ea8a9801-3531-488a-b43a-1a98195c4843" released by "delete_volume" :: held 1.672s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-492d88a0-4b15-4d81-ac81-98bca131d795-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-492d88a0-4b15-4d81-ac81-98bca131d795-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-492d88a0-4b15-4d81-ac81-98bca131d795" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Created reservations ['35bebd45-3a5c-408d-afe6-b6dff08aa734', 'cc94a821-a05b-4ab7-a6fe-2e43ab891646', 'bb782a39-4970-4a81-bca2-70243c6911f7', '26b4c27e-d1ef-4828-b941-90c52476e890'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-492d88a0-4b15-4d81-ac81-98bca131d795" acquired by "delete_volume" :: waited 0.060s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7e0ed-590c-44f6-b567-6be01685fe06]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:24 devstack sudo[115441]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.587s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleted volume successfully.
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:24 devstack sudo[115445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c7d2eb6-6ebf-4b08-92f6-96d283896bfc tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-2e3fbd07-1515-4cf3-9c8a-4be74356d9b1-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:24 devstack sudo[115445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:24 devstack sudo[115381]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5" returned: 0 in 5.630s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:25:24 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Converted 1024.00 MB image at 181.86 MB/s
Aug 26 03:25:24 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 is being set with open permissions: ugo+rw
Aug 26 03:25:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:24 devstack sudo[115447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5
Aug 26 03:25:24 devstack sudo[115447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:24 devstack sudo[115444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795
Aug 26 03:25:24 devstack sudo[115444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:25 devstack sudo[115445]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.290s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-865bfde9-2a8e-4351-98ca-d8d2426011fb tempest-ProjectMemberTests-1509217531 None] Lock "cinder-ea8a9801-3531-488a-b43a-1a98195c4843-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:25 devstack sudo[115447]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5" returned: 0 in 0.313s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-86cfeada-9993-4cb3-bd04-54274501d2a5" released by "_copy_volume_from_snapshot" :: held 6.811s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:25 devstack sudo[115444]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f-86cfeada-9993-4cb3-bd04-54274501d2a5" released by "_create_volume_from_snapshot" :: held 6.885s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.918s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.615s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997086205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bc353c-720a-4bc0-8b51-013edb6496e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa1737abde3411aa5517206436865db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:16Z,use_quota=True,user_id='5d9216e1f47448138764241cb1a5f13a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Creating volume 47bc353c-720a-4bc0-8b51-013edb6496e9 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:25 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795" returned: 0 in 0.563s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:25 devstack sudo[115455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9 1073741824
Aug 26 03:25:25 devstack sudo[115455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:25 devstack sudo[115456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795
Aug 26 03:25:25 devstack sudo[115456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ee1e5e-4af6-42ee-86f2-26a4715782b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86cfeada-9993-4cb3-bd04-54274501d2a5', 'volume_size': 1, 'snapshot_id': '34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f366cc-2354-4606-87c1-d9475d82af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:25 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Volume volume-86cfeada-9993-4cb3-bd04-54274501d2a5 (86cfeada-9993-4cb3-bd04-54274501d2a5): created successfully
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f366cc-2354-4606-87c1-d9475d82af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Flow 'volume_create_manager' (a92558a1-5197-44b7-91a3-1181552d6ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (d444fce7-ba53-4252-b905-dd69807bfaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1cbb8f-001c-446b-978c-51d2f153ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1cbb8f-001c-446b-978c-51d2f153ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522717626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f788f3-709d-4cef-99f0-9638a8a603ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:25Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8551fef2-a01e-4c70-84b8-c7ce93922216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8551fef2-a01e-4c70-84b8-c7ce93922216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8919f2-94a7-4dcf-baf7-3b86ddbb0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8919f2-94a7-4dcf-baf7-3b86ddbb0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f788f3-709d-4cef-99f0-9638a8a603ce', 'volume_name': 'volume-68f788f3-709d-4cef-99f0-9638a8a603ce', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192401b1-5fc7-442c-bb8f-fb253bb8a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192401b1-5fc7-442c-bb8f-fb253bb8a35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647d9dd1-f117-48b0-a156-be29a580bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:25 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Volume 68f788f3-709d-4cef-99f0-9638a8a603ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f788f3-709d-4cef-99f0-9638a8a603ce', 'volume_size': 1}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6af5a4cc-a867-4653-aa6f-d8363b346a15 tempest-VolumeDependencyTests-90513123 None] Created volume successfully.
Aug 26 03:25:25 devstack sudo[115456]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-492d88a0-4b15-4d81-ac81-98bca131d795" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-492d88a0-4b15-4d81-ac81-98bca131d795" released by "delete_volume" :: held 0.988s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['31d62f20-fa41-4389-aae1-773ff3f87f44', '8521f213-d780-4779-87bc-c48c558a79f0', 'bf72cb4d-709f-466f-8baa-fec200f9b22c', '96eb3cbf-b37c-4e5a-8057-e57bba283d70'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:25 devstack sudo[115455]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9 1073741824" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:25 devstack sudo[115464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:25 devstack sudo[115464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-f11c6c15-c7d7-4604-92cc-7b395923e64b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-f11c6c15-c7d7-4604-92cc-7b395923e64b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-quobyte-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-f11c6c15-c7d7-4604-92cc-7b395923e64b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:25 devstack sudo[115466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9
Aug 26 03:25:25 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-quobyte-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-f11c6c15-c7d7-4604-92cc-7b395923e64b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleting offline snapshot f11c6c15-c7d7-4604-92cc-7b395923e64b of volume 0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] snapshot_file for this snap is: volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Deleting offline snapshot 34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f of volume 82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] snapshot_file for this snap is: volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e11f7-bd55-4f02-9a65-8a033a6d8c9f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc6d672-5ff1-4fb4-9898-bd040880a5ad]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:25 devstack sudo[115464]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.286s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:26 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleted volume successfully.
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7c34cbb1-8102-434f-8df9-cc19ca6f8799 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-492d88a0-4b15-4d81-ac81-98bca131d795-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:26 devstack sudo[115468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b
Aug 26 03:25:26 devstack sudo[115468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack sudo[115469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f
Aug 26 03:25:26 devstack sudo[115469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9" returned: 0 in 0.280s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522717626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f788f3-709d-4cef-99f0-9638a8a603ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:25Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Creating volume 68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:26 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8b9763-f592-4e3f-a717-a495d98eb078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bc353c-720a-4bc0-8b51-013edb6496e9', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3b9e57-78de-410b-a8a3-5a30fead3eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:26 devstack sudo[115474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce 1073741824
Aug 26 03:25:26 devstack sudo[115474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Volume volume-47bc353c-720a-4bc0-8b51-013edb6496e9 (47bc353c-720a-4bc0-8b51-013edb6496e9): created successfully
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3b9e57-78de-410b-a8a3-5a30fead3eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Flow 'volume_create_manager' (4d356695-a111-4c63-9cfb-1239d44cae89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:26 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-9a7770a8-6e3d-47f8-9fe9-e1f617d3add1 tempest-ProjectReaderTests-2003765347 None] Created volume successfully.
Aug 26 03:25:26 devstack sudo[115469]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" returned: 0 in 0.395s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:26 devstack sudo[115468]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b" returned: 0 in 0.426s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74177c9-9f28-42f5-ab95-061435d9a078]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e43a0a-a1ca-4dfe-b589-0233e1098e60]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:26 devstack sudo[115484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11
Aug 26 03:25:26 devstack sudo[115484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack sudo[115486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c
Aug 26 03:25:26 devstack sudo[115486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "cinder-47bc353c-720a-4bc0-8b51-013edb6496e9-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-47bc353c-720a-4bc0-8b51-013edb6496e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "cinder-quobyte-47bc353c-720a-4bc0-8b51-013edb6496e9" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-quobyte-47bc353c-720a-4bc0-8b51-013edb6496e9" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:26 devstack sudo[115474]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce 1073741824" returned: 0 in 0.585s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[376037ee-4aad-46e2-9c98-9d3eab813f1f]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:26 devstack sudo[115492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce
Aug 26 03:25:26 devstack sudo[115492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack sudo[115489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9
Aug 26 03:25:26 devstack sudo[115489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:26 devstack sudo[115486]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" returned: 0 in 0.484s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:26 devstack sudo[115498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b
Aug 26 03:25:26 devstack sudo[115498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack sudo[115484]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" returned: 0 in 0.638s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:27 devstack sudo[115492]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack sudo[115503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f
Aug 26 03:25:27 devstack sudo[115503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce" returned: 0 in 0.294s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647d9dd1-f117-48b0-a156-be29a580bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f788f3-709d-4cef-99f0-9638a8a603ce', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e591de2-962e-468e-9b59-6860657332fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:27 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Volume volume-68f788f3-709d-4cef-99f0-9638a8a603ce (68f788f3-709d-4cef-99f0-9638a8a603ce): created successfully
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e591de2-962e-468e-9b59-6860657332fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (d444fce7-ba53-4252-b905-dd69807bfaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ba5096d7-01c9-400a-9e9f-55c1d72b6123 tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:25:27 devstack sudo[115489]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9" returned: 0 in 0.423s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:27 devstack sudo[115510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9
Aug 26 03:25:27 devstack sudo[115510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack sudo[115498]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b" returned: 0 in 0.389s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:27 devstack sudo[115516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b
Aug 26 03:25:27 devstack sudo[115516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack sudo[115503]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" returned: 0 in 0.390s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:27 devstack sudo[115510]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-47bc353c-720a-4bc0-8b51-013edb6496e9" returned: 0 in 0.299s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-quobyte-47bc353c-720a-4bc0-8b51-013edb6496e9" released by "delete_volume" :: held 0.784s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:27 devstack sudo[115520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f
Aug 26 03:25:27 devstack sudo[115520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Created reservations ['a4a47ab4-910d-48b9-bc37-82ebef57e261', '6f8f8910-d525-4b3a-8db2-e0a9856613b4', '2cedf8ad-59d2-43d1-9511-999e29538e08', '9208cf93-edc4-4009-9a69-cecc8360bcdc'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:27 devstack sudo[115516]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c.f11c6c15-c7d7-4604-92cc-7b395923e64b" returned: 0 in 0.347s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-f11c6c15-c7d7-4604-92cc-7b395923e64b" released by "_delete_snapshot" :: held 1.824s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" released by "delete_snapshot" :: held 1.871s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:27 devstack sudo[115524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:27 devstack sudo[115524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot 0b04696d-93fb-4e65-a69e-d6381afd0f52 of volume 68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:27 devstack sudo[115520]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11.34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" returned: 0 in 0.383s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70424307-350a-4ddf-90db-940d7108f433]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f" released by "_delete_snapshot" :: held 1.958s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" released by "delete_snapshot" :: held 2.017s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['121dc851-a618-4dcb-bf05-0c6b958816e4', '40035e07-08f2-4f09-9379-841632acf03a', 'fa0e5e75-b56a-4273-bf79-7aa6ceb60c1a', 'b62209bb-6cb1-4704-bf4e-6aad7eeeafb9'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:27 devstack sudo[115526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce
Aug 26 03:25:27 devstack sudo[115526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:27 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Created reservations ['d70e49fe-bd9f-46fe-b506-ab4093d9ee97', 'fc1c447b-3916-47bc-9252-9a028786908d', 'e950c827-9400-4802-8720-a783ff7d5d04', 'db9bac1f-4cca-42e9-bbc5-01f3adf3e211'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Delete snapshot completed successfully.
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-85ab1d12-4451-4324-b6f2-0983b2e6b0cb tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-f11c6c15-c7d7-4604-92cc-7b395923e64b-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:28 devstack sudo[115524]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.307s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Deleted volume successfully.
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-f1f59007-fb13-44e7-a641-91daf44be7b0 tempest-ProjectReaderTests-2003765347 None] Lock "cinder-47bc353c-720a-4bc0-8b51-013edb6496e9-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:28 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Delete snapshot completed successfully.
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-89329e9d-b7db-4fc1-a39e-a7bff63db3c3 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-34f3c2c2-73b8-4c23-b4c4-adf5621d5b0f-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:28 devstack sudo[115526]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce" returned: 0 in 0.470s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:28 devstack sudo[115532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 1G
Aug 26 03:25:28 devstack sudo[115532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:28 devstack sudo[115532]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 1G" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f788f3-709d-4cef-99f0-9638a8a603ce -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:28 devstack sudo[115537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f788f3-709d-4cef-99f0-9638a8a603ce -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52
Aug 26 03:25:28 devstack sudo[115537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:29 devstack sudo[115537]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f788f3-709d-4cef-99f0-9638a8a603ce -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52" returned: 0 in 0.330s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:29 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 is being set with open permissions: ugo+rw
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-82bcae4f-9d0d-4e06-aad7-7ead45c7af11-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:29 devstack sudo[115542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52
Aug 26 03:25:29 devstack sudo[115542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Lock "cinder-82bcae4f-9d0d-4e06-aad7-7ead45c7af11-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "cinder-quobyte-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-quobyte-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6606d58e-ef41-4055-8c08-c5cb2e52e176]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d6fe20-cb84-4c7b-ad98-9c3c4b3321eb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack sudo[115542]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52" returned: 0 in 0.304s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack sudo[115544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c
Aug 26 03:25:29 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack sudo[115545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11
Aug 26 03:25:29 devstack sudo[115545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack sudo[115547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info
Aug 26 03:25:29 devstack sudo[115547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack sudo[115547]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:29 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info is being set with open permissions: ugo+rw
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" returned: 0 in 0.475s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack sudo[115560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info
Aug 26 03:25:29 devstack sudo[115560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack sudo[115545]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" returned: 0 in 0.473s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:29 devstack sudo[115562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c
Aug 26 03:25:29 devstack sudo[115562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack sudo[115563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11
Aug 26 03:25:29 devstack sudo[115563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:29 devstack sudo[115560]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.info" returned: 0 in 0.263s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:29 devstack sudo[115562]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" returned: 0 in 0.282s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-quobyte-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c" released by "delete_volume" :: held 0.871s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:30 devstack sudo[115563]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" returned: 0 in 0.300s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4af4f6d1-4e86-4c1d-90d2-cb897d829744 tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-82bcae4f-9d0d-4e06-aad7-7ead45c7af11" released by "delete_volume" :: held 0.851s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Created reservations ['bbc87246-d500-49cf-b898-dfc80f157519', '4e1a25fd-cd16-4be3-8143-b5e19f0711b1', 'cc7f8c05-5a9f-4d80-858d-c0d3638b8498', '41d26521-63a9-4cdf-8cc3-ba10cea79fae'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Created reservations ['775ba594-1485-4b21-aff6-2628a83984de', '7a4c44c2-63b4-4731-a72e-19f534473da8', '3c5b7dfb-3b21-4767-85d9-c68b20943284', 'd2bbc5a1-6217-4643-b97b-c3d3823c1f09'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:30 devstack sudo[115569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:30 devstack sudo[115569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-86cfeada-9993-4cb3-bd04-54274501d2a5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:30 devstack sudo[115571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:30 devstack sudo[115571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-86cfeada-9993-4cb3-bd04-54274501d2a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "cinder-quobyte-86cfeada-9993-4cb3-bd04-54274501d2a5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-86cfeada-9993-4cb3-bd04-54274501d2a5" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a1b08-6abb-4bb6-9c88-2a216e25256e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:30 devstack sudo[115573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5
Aug 26 03:25:30 devstack sudo[115573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:30 devstack sudo[115569]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.356s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:30 devstack sudo[115571]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Deleted volume successfully.
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.320s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Deleted volume successfully.
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-42a2268b-2fdc-4f80-bc93-16c2ba9415e4 tempest-CreateVolumesFromSnapshotTest-599116991 None] Lock "cinder-0a2dc1cb-65ab-41d0-9b87-0c42f273f56c-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e2a08b05-05ed-4a51-8ec6-5127793df48b tempest-VolumeDependencyTests-90513123 None] Lock "cinder-82bcae4f-9d0d-4e06-aad7-7ead45c7af11-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-0b04696d-93fb-4e65-a69e-d6381afd0f52-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-0b04696d-93fb-4e65-a69e-d6381afd0f52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-68f788f3-709d-4cef-99f0-9638a8a603ce" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-68f788f3-709d-4cef-99f0-9638a8a603ce" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-0b04696d-93fb-4e65-a69e-d6381afd0f52" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-0b04696d-93fb-4e65-a69e-d6381afd0f52" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot 0b04696d-93fb-4e65-a69e-d6381afd0f52 of volume 68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:30 devstack sudo[115573]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5" returned: 0 in 0.448s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98ab3e2-2203-4875-84a4-9dbe39899553]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:30 devstack sudo[115580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5
Aug 26 03:25:30 devstack sudo[115580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:31 devstack sudo[115581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52
Aug 26 03:25:31 devstack sudo[115581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:31 devstack sudo[115580]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-86cfeada-9993-4cb3-bd04-54274501d2a5" returned: 0 in 0.250s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-quobyte-86cfeada-9993-4cb3-bd04-54274501d2a5" released by "delete_volume" :: held 0.763s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Created reservations ['52ae7523-b961-402a-92e4-11ea6ad6d350', 'eebd5376-58bf-40a2-98de-c9a832e53f29', '5715604a-bff8-4429-93b1-8f0357b9863c', '8b124ecc-af6b-4ea5-98ea-5dfbd5b334b3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:31 devstack sudo[115581]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52" returned: 0 in 0.429s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68f788f3-709d-4cef-99f0-9638a8a603ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:31 devstack sudo[115588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:31 devstack sudo[115588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5519ac-d85b-4e50-bf1b-85b8db7ef363]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:31 devstack sudo[115590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce
Aug 26 03:25:31 devstack sudo[115590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:31 devstack sudo[115588]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:31 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Deleted volume successfully.
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-1efc55ff-2d83-481d-886b-e08d561e76a7 tempest-VolumeDependencyTests-90513123 None] Lock "cinder-86cfeada-9993-4cb3-bd04-54274501d2a5-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:31 devstack sudo[115590]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce" returned: 0 in 0.546s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:31 devstack sudo[115597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52
Aug 26 03:25:31 devstack sudo[115597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:32 devstack sudo[115597]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52" returned: 0 in 0.444s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:32 devstack sudo[115602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52
Aug 26 03:25:32 devstack sudo[115602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:32 devstack sudo[115602]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce.0b04696d-93fb-4e65-a69e-d6381afd0f52" returned: 0 in 0.392s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-0b04696d-93fb-4e65-a69e-d6381afd0f52" released by "_delete_snapshot" :: held 1.961s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-68f788f3-709d-4cef-99f0-9638a8a603ce" released by "delete_snapshot" :: held 1.994s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Created reservations ['fdeacaa7-6eca-4fb3-8f92-d7f690256e9b', 'ee0d0d0e-bbd3-4057-abd1-30fdf84b66f4', 'bc980f5d-a3fe-455b-b2bc-8dbb78cc4f62', '91e46670-ba22-4987-9d19-40c47128b9a3'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:25:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c6f1407f-2b4b-40d3-ac25-147b6ae49939 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-0b04696d-93fb-4e65-a69e-d6381afd0f52-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-68f788f3-709d-4cef-99f0-9638a8a603ce-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Lock "cinder-68f788f3-709d-4cef-99f0-9638a8a603ce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-68f788f3-709d-4cef-99f0-9638a8a603ce" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-68f788f3-709d-4cef-99f0-9638a8a603ce" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[967665df-e314-4cdc-96c8-f4c5ee16b9d1]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:34 devstack sudo[115605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce
Aug 26 03:25:34 devstack sudo[115605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:34 devstack sudo[115605]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce" returned: 0 in 0.507s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:34 devstack sudo[115610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce
Aug 26 03:25:34 devstack sudo[115610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:35 devstack sudo[115610]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-68f788f3-709d-4cef-99f0-9638a8a603ce" returned: 0 in 0.315s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-68f788f3-709d-4cef-99f0-9638a8a603ce" released by "delete_volume" :: held 0.910s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Created reservations ['e026e291-7015-4287-bc53-390312e97e39', 'e1a94c0c-3502-4935-8ce5-e69fda04ec3a', 'af65b481-0fb3-434f-b0c1-16c95d3c4385', '15e3c1d7-6f53-4779-9e64-329bc6506480'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:35 devstack sudo[115613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:35 devstack sudo[115613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:35 devstack sudo[115613]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.339s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c9ffc0cd-85bb-4626-9d84-3ab130a52edc tempest-ProjectMemberTests-1509217531 None] Lock "cinder-68f788f3-709d-4cef-99f0-9638a8a603ce-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:35 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (d2486d47-bd2a-41f7-beb5-e973641d868f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152263f4-f3c2-4748-86e6-cad0e12eff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152263f4-f3c2-4748-86e6-cad0e12eff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536658495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4910e696-93a1-4993-9990-2b959743dbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:36Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b47071-1086-4917-8578-34895c6140a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b47071-1086-4917-8578-34895c6140a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261e3053-6f74-4f70-8319-12ec22833712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261e3053-6f74-4f70-8319-12ec22833712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4910e696-93a1-4993-9990-2b959743dbef', 'volume_name': 'volume-4910e696-93a1-4993-9990-2b959743dbef', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc6c061-3e00-4dcf-9921-70fde15af70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc6c061-3e00-4dcf-9921-70fde15af70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7a1b7e-1384-4f58-9fb0-61406554d697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Volume 4910e696-93a1-4993-9990-2b959743dbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4910e696-93a1-4993-9990-2b959743dbef', 'volume_size': 1}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1536658495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4910e696-93a1-4993-9990-2b959743dbef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:36Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Creating volume 4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:36 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:36 devstack sudo[115616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef 1073741824
Aug 26 03:25:36 devstack sudo[115616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Flow 'volume_create_manager' (0b5fa31b-b62d-494d-b7f2-375bf6fd60f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5cb722-1d34-479a-a3ee-50ec0a1722ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5cb722-1d34-479a-a3ee-50ec0a1722ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f94f6d8-871d-44e3-aab9-55c34ba1e468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b434b25ad7b4473dae15c569ad614fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:36Z,use_quota=True,user_id='51e6b08b8a5f4e65855787b5fcc134c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844a5313-35c8-448a-b7db-4df0b72c2b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844a5313-35c8-448a-b7db-4df0b72c2b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe744b4-5bbc-41a3-ae4a-07b4f69ccc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe744b4-5bbc-41a3-ae4a-07b4f69ccc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f94f6d8-871d-44e3-aab9-55c34ba1e468', 'volume_name': 'volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dd25bf-6cb1-4e2c-8510-5255bf13cb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dd25bf-6cb1-4e2c-8510-5255bf13cb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25716dda-7712-4cff-bd41-00b30364aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Volume 9f94f6d8-871d-44e3-aab9-55c34ba1e468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468', 'volume_size': 1}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:36 devstack sudo[115616]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef 1073741824" returned: 0 in 0.488s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:36 devstack sudo[115622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef
Aug 26 03:25:36 devstack sudo[115622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:36 devstack sudo[115622]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef" returned: 0 in 0.250s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f94f6d8-871d-44e3-aab9-55c34ba1e468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b434b25ad7b4473dae15c569ad614fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:36Z,use_quota=True,user_id='51e6b08b8a5f4e65855787b5fcc134c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Creating volume 9f94f6d8-871d-44e3-aab9-55c34ba1e468 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:36 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7a1b7e-1384-4f58-9fb0-61406554d697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4910e696-93a1-4993-9990-2b959743dbef', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc3cdf8-e900-4446-8f29-1a8653d606ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:36 devstack sudo[115625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 1073741824
Aug 26 03:25:36 devstack sudo[115625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:36 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Volume volume-4910e696-93a1-4993-9990-2b959743dbef (4910e696-93a1-4993-9990-2b959743dbef): created successfully
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc3cdf8-e900-4446-8f29-1a8653d606ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:36 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (d2486d47-bd2a-41f7-beb5-e973641d868f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-779d9743-960f-493d-a46b-f8535891678c tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:25:37 devstack sudo[115625]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 1073741824" returned: 0 in 0.451s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:37 devstack sudo[115631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468
Aug 26 03:25:37 devstack sudo[115631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:37 devstack sudo[115631]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25716dda-7712-4cff-bd41-00b30364aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9a7122-f466-4ba7-84ab-69e8f8dbadad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Volume volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 (9f94f6d8-871d-44e3-aab9-55c34ba1e468): created successfully
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9a7122-f466-4ba7-84ab-69e8f8dbadad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Flow 'volume_create_manager' (0b5fa31b-b62d-494d-b7f2-375bf6fd60f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:37 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2f5afbe5-4f1a-4084-b2b8-4efd8edfa4ba tempest-CinderUnicodeTest-1542150150 None] Created volume successfully.
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=226,cinder:UPDATE=307,cinder:INSERT=99,cinder:DELETE=23 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot ffdc8f34-3f65-4d8a-b5b3-196cb3614ead of volume 4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed677a0c-1643-4c80-a8ee-962d0efa193b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:38 devstack sudo[115634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef
Aug 26 03:25:38 devstack sudo[115634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:38 devstack sudo[115634]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef" returned: 0 in 0.480s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:38 devstack sudo[115639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead 1G
Aug 26 03:25:38 devstack sudo[115639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=231,cinder:UPDATE=320,cinder:DELETE=33,cinder:INSERT=67 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Flow 'volume_create_manager' (79436f32-6541-4a84-a8b1-879ef1294fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74706127-8624-48ca-8040-3d5a5b74f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74706127-8624-48ca-8040-3d5a5b74f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-160170901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b434b25ad7b4473dae15c569ad614fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:39Z,use_quota=True,user_id='51e6b08b8a5f4e65855787b5fcc134c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6a03f7-70b1-41e4-a895-fd0691a4b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6a03f7-70b1-41e4-a895-fd0691a4b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628a58e1-be25-4807-8383-4436c251009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628a58e1-be25-4807-8383-4436c251009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5', 'volume_name': 'volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b442be3-2134-4bad-8ce9-8f902ceb0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b442be3-2134-4bad-8ce9-8f902ceb0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90db53bf-8ca8-416c-b7ae-af9700ee46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:39 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Volume 486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5', 'volume_size': 1}
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:39 devstack sudo[115639]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead 1G" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910e696-93a1-4993-9990-2b959743dbef -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:39 devstack sudo[115645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910e696-93a1-4993-9990-2b959743dbef -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead
Aug 26 03:25:39 devstack sudo[115645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:39 devstack sudo[115645]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910e696-93a1-4993-9990-2b959743dbef -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" returned: 0 in 0.315s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:39 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead is being set with open permissions: ugo+rw
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:39 devstack sudo[115651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead
Aug 26 03:25:39 devstack sudo[115651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:39 devstack sudo[115651]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" returned: 0 in 0.247s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:39 devstack sudo[115654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info
Aug 26 03:25:39 devstack sudo[115654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:40 devstack sudo[115654]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info" returned: 0 in 0.254s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:40 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info is being set with open permissions: ugo+rw
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:40 devstack sudo[115657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info
Aug 26 03:25:40 devstack sudo[115657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:40 devstack sudo[115657]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.info" returned: 0 in 0.271s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-160170901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b434b25ad7b4473dae15c569ad614fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:39Z,use_quota=True,user_id='51e6b08b8a5f4e65855787b5fcc134c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Creating volume 486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:40 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:40 devstack sudo[115660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 1073741824
Aug 26 03:25:40 devstack sudo[115660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0bf10ba8-10c2-46f4-9df2-0481e522eadb tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:25:40 devstack sudo[115660]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 1073741824" returned: 0 in 0.450s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:40 devstack sudo[115666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5
Aug 26 03:25:40 devstack sudo[115666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:41 devstack sudo[115666]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" returned: 0 in 0.268s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90db53bf-8ca8-416c-b7ae-af9700ee46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ba9143-da13-49a8-b43d-7b9c324033ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Volume volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 (486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5): created successfully
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ba9143-da13-49a8-b43d-7b9c324033ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Flow 'volume_create_manager' (79436f32-6541-4a84-a8b1-879ef1294fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-97be6a06-15dd-4015-865a-94a9a95459fc tempest-CinderUnicodeTest-1542150150 None] Created volume successfully.
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-ffdc8f34-3f65-4d8a-b5b3-196cb3614ead-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-ffdc8f34-3f65-4d8a-b5b3-196cb3614ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-4910e696-93a1-4993-9990-2b959743dbef" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-4910e696-93a1-4993-9990-2b959743dbef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot ffdc8f34-3f65-4d8a-b5b3-196cb3614ead of volume 4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a77e7d-7187-4ed5-9317-e2763db309dd]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:41 devstack sudo[115669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead
Aug 26 03:25:41 devstack sudo[115669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:41 devstack sudo[115669]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" returned: 0 in 0.357s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4910e696-93a1-4993-9990-2b959743dbef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d72363d-b60d-463f-bd7d-4e22e5b3f7b9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:41 devstack sudo[115675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef
Aug 26 03:25:41 devstack sudo[115675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:42 devstack sudo[115675]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef" returned: 0 in 0.394s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:42 devstack sudo[115680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead
Aug 26 03:25:42 devstack sudo[115680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Creating offline snapshot 4cad31dc-d83b-4dd2-88dc-796a791d559e of volume 486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b87b85-2dad-4309-b756-2f2a9bfee27a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:42 devstack sudo[115682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5
Aug 26 03:25:42 devstack sudo[115682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:42 devstack sudo[115680]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" returned: 0 in 0.412s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:42 devstack sudo[115688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead
Aug 26 03:25:42 devstack sudo[115688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:42 devstack sudo[115682]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" returned: 0 in 0.471s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:42 devstack sudo[115694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e 1G
Aug 26 03:25:42 devstack sudo[115694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:42 devstack sudo[115688]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef.ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" returned: 0 in 0.303s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-ffdc8f34-3f65-4d8a-b5b3-196cb3614ead" released by "_delete_snapshot" :: held 1.581s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-4910e696-93a1-4993-9990-2b959743dbef" released by "delete_snapshot" :: held 1.609s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Created reservations ['7e401fb3-349d-4d25-888a-22371ac33dae', 'f4760680-bb1e-4640-80fe-fbc0a933b12c', '534fc588-cb70-4cbf-8ee5-b8b3267b46fb', '4e19cb75-b17f-4a36-831b-25da5a908bc6'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7bac2c4e-e049-44f6-9b2e-19e816210c42 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-ffdc8f34-3f65-4d8a-b5b3-196cb3614ead-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:43 devstack sudo[115694]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e 1G" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:43 devstack sudo[115702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e
Aug 26 03:25:43 devstack sudo[115702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-4910e696-93a1-4993-9990-2b959743dbef-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-4910e696-93a1-4993-9990-2b959743dbef-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:43 devstack sudo[115702]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e" returned: 0 in 0.352s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:43 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e is being set with open permissions: ugo+rw
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:43 devstack sudo[115707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e
Aug 26 03:25:43 devstack sudo[115707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-4910e696-93a1-4993-9990-2b959743dbef" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-4910e696-93a1-4993-9990-2b959743dbef" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d2e0fa-a499-4e2e-8269-662ca4062642]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:43 devstack sudo[115709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef
Aug 26 03:25:43 devstack sudo[115709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:43 devstack sudo[115707]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e" returned: 0 in 0.276s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:44 devstack sudo[115712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info
Aug 26 03:25:44 devstack sudo[115712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:44 devstack sudo[115709]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef" returned: 0 in 0.388s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:44 devstack sudo[115717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef
Aug 26 03:25:44 devstack sudo[115717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:44 devstack sudo[115712]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info" returned: 0 in 0.286s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:44 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info is being set with open permissions: ugo+rw
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:44 devstack sudo[115720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info
Aug 26 03:25:44 devstack sudo[115720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:44 devstack sudo[115717]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-4910e696-93a1-4993-9990-2b959743dbef" returned: 0 in 0.286s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-4910e696-93a1-4993-9990-2b959743dbef" released by "delete_volume" :: held 0.744s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:44 devstack sudo[115720]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Created reservations ['470fc5b2-e4b8-4800-939d-a11c647d8265', '05640eab-b99a-4b57-8a93-f63789dfa48e', '61645321-95d3-42ad-b793-302a217e6392', '3ef121f5-916f-4abb-b8b2-a50eccb881b0'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.info" returned: 0 in 0.269s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ae45e2f9-a360-4c28-8694-3cd2cd14e41c tempest-CinderUnicodeTest-1542150150 None] Create snapshot completed successfully
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:44 devstack sudo[115724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:44 devstack sudo[115724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:44 devstack sudo[115724]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:44 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:25:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6fb198db-8d36-480d-a861-375f963c3fb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-4910e696-93a1-4993-9990-2b959743dbef-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (94952e37-dfc5-4cfe-a790-35a2bd6c60be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e020c78e-b811-4e6b-a28c-aa76bb1e3d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e020c78e-b811-4e6b-a28c-aa76bb1e3d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930718655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:45Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f010a2ec-8d33-4d24-b73c-799f84a75162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f010a2ec-8d33-4d24-b73c-799f84a75162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870fda6a-7307-424c-8b44-d7017867a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870fda6a-7307-424c-8b44-d7017867a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d', 'volume_name': 'volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22936ee5-f324-43d4-bd5c-344a9cd93b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22936ee5-f324-43d4-bd5c-344a9cd93b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32620e51-816b-468a-af91-03825e117023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:45 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Volume 2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d', 'volume_size': 1}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930718655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:45Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Creating volume 2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:45 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:45 devstack sudo[115727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d 1073741824
Aug 26 03:25:45 devstack sudo[115727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-4cad31dc-d83b-4dd2-88dc-796a791d559e-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-4cad31dc-d83b-4dd2-88dc-796a791d559e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-quobyte-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-quobyte-4cad31dc-d83b-4dd2-88dc-796a791d559e" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-4cad31dc-d83b-4dd2-88dc-796a791d559e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Deleting offline snapshot 4cad31dc-d83b-4dd2-88dc-796a791d559e of volume 486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] snapshot_file for this snap is: volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc90259-be89-4f73-ab4b-ba8a4f1eb1cc]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:45 devstack sudo[115732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e
Aug 26 03:25:45 devstack sudo[115732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:45 devstack sudo[115727]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d 1073741824" returned: 0 in 0.534s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:45 devstack sudo[115734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d
Aug 26 03:25:45 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:46 devstack sudo[115732]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d30ebb-ed0a-4299-86fc-e5a392b49703]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:46 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" returned: 0 in 0.282s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32620e51-816b-468a-af91-03825e117023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fad703-22ad-4f8a-ba68-4176b3522b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:46 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Volume volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d (2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d): created successfully
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fad703-22ad-4f8a-ba68-4176b3522b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:46 devstack sudo[115739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5
Aug 26 03:25:46 devstack sudo[115739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (94952e37-dfc5-4cfe-a790-35a2bd6c60be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:46 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-57c92e7a-00c0-4a03-aebf-e0622e09d17e tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:25:46 devstack sudo[115739]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" returned: 0 in 0.431s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:46 devstack sudo[115745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e
Aug 26 03:25:46 devstack sudo[115745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:46 devstack sudo[115745]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e" returned: 0 in 0.337s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:46 devstack sudo[115750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e
Aug 26 03:25:46 devstack sudo[115750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:47 devstack sudo[115750]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5.4cad31dc-d83b-4dd2-88dc-796a791d559e" returned: 0 in 0.266s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-4cad31dc-d83b-4dd2-88dc-796a791d559e" released by "_delete_snapshot" :: held 1.550s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" released by "delete_snapshot" :: held 1.576s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Created reservations ['50f14284-57eb-4940-b750-91011d0f53c6', 'd4de828a-1c90-47a0-8c90-f85aeda5b78a', '8011fecd-1eee-4f88-85a2-d12aaf96498e', 'b39fb104-d56e-49b8-a7df-51680eb54f38'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Delete snapshot completed successfully.
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-22a2e060-b740-4218-9c00-cb435183e7d6 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-4cad31dc-d83b-4dd2-88dc-796a791d559e-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot f0fd3603-ae1f-453e-bb60-aace834c5d3c of volume 2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbfa3b-8c26-4068-a3b5-067fad38f037]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:47 devstack sudo[115753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d
Aug 26 03:25:47 devstack sudo[115753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-quobyte-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba20a2c6-afbd-41b3-92ad-4d55c47d4178]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:48 devstack sudo[115753]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" returned: 0 in 0.463s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:48 devstack sudo[115795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c 1G
Aug 26 03:25:48 devstack sudo[115795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:48 devstack sudo[115791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5
Aug 26 03:25:48 devstack sudo[115791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:48 devstack sudo[115791]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:48 devstack sudo[115804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5
Aug 26 03:25:48 devstack sudo[115804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:48 devstack sudo[115795]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c 1G" returned: 0 in 0.453s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:48 devstack sudo[115807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c
Aug 26 03:25:48 devstack sudo[115807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:48 devstack sudo[115804]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" returned: 0 in 0.284s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5" released by "delete_volume" :: held 0.764s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Created reservations ['4683f2ff-b530-4b1b-9d07-86f75bdbef12', '7803584b-a566-4cba-850a-9cd2547d33c4', '85fc88c2-e167-495f-a8b3-6f00cc8a61c8', '6a1ee345-a54d-4844-a8fc-f86cc22ce323'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:48 devstack sudo[115807]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c" returned: 0 in 0.352s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:48 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c is being set with open permissions: ugo+rw
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:48 devstack sudo[115813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:48 devstack sudo[115813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:48 devstack sudo[115814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c
Aug 26 03:25:48 devstack sudo[115814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-9f94f6d8-871d-44e3-aab9-55c34ba1e468-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-9f94f6d8-871d-44e3-aab9-55c34ba1e468-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "cinder-quobyte-9f94f6d8-871d-44e3-aab9-55c34ba1e468" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-9f94f6d8-871d-44e3-aab9-55c34ba1e468" acquired by "delete_volume" :: waited 0.036s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:49 devstack sudo[115813]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.309s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:49 devstack sudo[115814]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff774bf2-613b-41dd-ab33-42bbcff1c8cf]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Deleted volume successfully.
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-960b2f4f-eeda-4ad8-9a66-af9cc5bdb6b9 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-486fcfcc-b5e5-4236-9e5a-1f5fd3c184e5-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:49 devstack sudo[115820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info
Aug 26 03:25:49 devstack sudo[115820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:49 devstack sudo[115819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468
Aug 26 03:25:49 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:49 devstack sudo[115820]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info" returned: 0 in 0.287s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:49 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info is being set with open permissions: ugo+rw
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:49 devstack sudo[115830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info
Aug 26 03:25:49 devstack sudo[115830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:49 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468" returned: 0 in 0.458s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:49 devstack sudo[115836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468
Aug 26 03:25:49 devstack sudo[115836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:49 devstack sudo[115830]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.info" returned: 0 in 0.284s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:49 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-93417b51-cc74-4590-869e-f8b072c99405 tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:25:49 devstack sudo[115836]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9f94f6d8-871d-44e3-aab9-55c34ba1e468" returned: 0 in 0.278s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-quobyte-9f94f6d8-871d-44e3-aab9-55c34ba1e468" released by "delete_volume" :: held 0.777s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Created reservations ['e8896850-6ed1-46e8-901b-4ca42c8dc9a0', '2d122449-f805-4108-a9f9-826accdeeaa1', 'ee26e7f0-7cbd-4cbe-a634-b53862de9388', '68890479-4672-4aa7-bd95-d9d94bbddad7'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:49 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:50 devstack sudo[115840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:50 devstack sudo[115840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:50 devstack sudo[115840]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.289s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:50 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Deleted volume successfully.
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d32459b5-b8da-4f2d-a030-72859a686b35 tempest-CinderUnicodeTest-1542150150 None] Lock "cinder-9f94f6d8-871d-44e3-aab9-55c34ba1e468-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-f0fd3603-ae1f-453e-bb60-aace834c5d3c-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-f0fd3603-ae1f-453e-bb60-aace834c5d3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-f0fd3603-ae1f-453e-bb60-aace834c5d3c" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-f0fd3603-ae1f-453e-bb60-aace834c5d3c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot f0fd3603-ae1f-453e-bb60-aace834c5d3c of volume 2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b1824-b1ec-4ef3-bfdd-b93a59989fd9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:50 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:50 devstack sudo[115843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c
Aug 26 03:25:50 devstack sudo[115843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:51 devstack sudo[115843]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c" returned: 0 in 0.407s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:51 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:25:51 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce84912-8b7a-460f-9804-4e1eb13cde31]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:51 devstack sudo[115848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d
Aug 26 03:25:51 devstack sudo[115848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:51 devstack sudo[115848]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" returned: 0 in 0.448s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:51 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:51 devstack sudo[115853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c
Aug 26 03:25:51 devstack sudo[115853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:52 devstack sudo[115853]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c" returned: 0 in 0.381s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:52 devstack sudo[115858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c
Aug 26 03:25:52 devstack sudo[115858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:52 devstack sudo[115858]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d.f0fd3603-ae1f-453e-bb60-aace834c5d3c" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-f0fd3603-ae1f-453e-bb60-aace834c5d3c" released by "_delete_snapshot" :: held 1.617s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" released by "delete_snapshot" :: held 1.647s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Created reservations ['7698e5b8-9ac4-4997-88cf-768545fa0d87', '4d10bc08-0fdd-42c6-90e2-892a448293e7', '205d9a8d-c0b5-4c5d-81e7-25936db90d50', '9cc61909-e4b4-4f5d-a88a-076aa8eab730'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:52 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-61aee06c-cf4f-4345-97e6-0d0f4b324cb0 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-f0fd3603-ae1f-453e-bb60-aace834c5d3c-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:25:52 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74988ad2-ec73-4dd0-9e75-a879424a290c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:53 devstack sudo[115861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d
Aug 26 03:25:53 devstack sudo[115861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:53 devstack sudo[115861]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" returned: 0 in 0.374s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:53 devstack sudo[115866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d
Aug 26 03:25:53 devstack sudo[115866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5076b11b-6f7f-4bd5-a9d5-87919cc9d1ab tempest-ProjectAdminTests-819677862 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.6434135437012, 'free_capacity_gb': 1774.6434135437012, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94326) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" returned: 0 in 0.400s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:53 devstack sudo[115866]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d" released by "delete_volume" :: held 0.862s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:53 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Created reservations ['1d7fe6b8-7fdc-47ef-a82c-2b48a3cd08ea', 'e5ff9a65-6596-45a9-9579-2c51979fb871', '27c233dc-dd3d-432e-aad0-e8f8ad68a6b2', '72e3041b-2d6f-47d3-b8b6-38cb4adf1ffb'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:54 devstack sudo[115869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:25:54 devstack sudo[115869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:54 devstack sudo[115869]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.389s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:25:54 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7dd62255-8be7-4f2d-b946-aee7241e60d1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-2dd8e8f2-0e57-4a38-9d1c-8bcc4c925d0d-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (72a0c40f-f06b-4b26-a442-dbc2ebc6b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bae92d2-cb4b-48f8-9f85-85929d5135e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bae92d2-cb4b-48f8-9f85-85929d5135e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123025355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c37fab-e99d-4d18-b10b-128c0a8393c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:55Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91e684d-5e41-427b-80c9-03759dd2a733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91e684d-5e41-427b-80c9-03759dd2a733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86629ee-749e-4ee3-b371-cc683ff7eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86629ee-749e-4ee3-b371-cc683ff7eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c37fab-e99d-4d18-b10b-128c0a8393c5', 'volume_name': 'volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051dafa1-e1fd-4c16-b8f3-a22ce0da861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051dafa1-e1fd-4c16-b8f3-a22ce0da861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650ee41a-2578-4282-b75b-f32fafa202d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:54 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Volume b1c37fab-e99d-4d18-b10b-128c0a8393c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5', 'volume_size': 1}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123025355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c37fab-e99d-4d18-b10b-128c0a8393c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:25:55Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Creating volume b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:25:54 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:25:54 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:54 devstack sudo[115872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 1073741824
Aug 26 03:25:54 devstack sudo[115872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:55 devstack sudo[115872]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 1073741824" returned: 0 in 0.510s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:55 devstack sudo[115878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5
Aug 26 03:25:55 devstack sudo[115878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:55 devstack sudo[115878]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5" returned: 0 in 0.319s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650ee41a-2578-4282-b75b-f32fafa202d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1dd78e-432f-4885-a946-d83cd94efe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:25:55 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Volume volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 (b1c37fab-e99d-4d18-b10b-128c0a8393c5): created successfully
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1dd78e-432f-4885-a946-d83cd94efe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:25:55 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (72a0c40f-f06b-4b26-a442-dbc2ebc6b544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:25:55 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-79ec0602-d3ff-4668-8145-94a85cbb25a7 tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot 53cc0222-1cce-4de7-8fc8-484df108d471 of volume b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ea30a-0bbe-4ca6-a3b7-2a26a11bc272]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:57 devstack sudo[115882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5
Aug 26 03:25:57 devstack sudo[115882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:57 devstack sudo[115882]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5" returned: 0 in 0.453s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:57 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:57 devstack sudo[115887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 1G
Aug 26 03:25:57 devstack sudo[115887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:58 devstack sudo[115887]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 1G" returned: 0 in 0.517s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:58 devstack sudo[115893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471
Aug 26 03:25:58 devstack sudo[115893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:58 devstack sudo[115893]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471" returned: 0 in 0.372s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:58 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 is being set with open permissions: ugo+rw
Aug 26 03:25:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:58 devstack sudo[115899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471
Aug 26 03:25:58 devstack sudo[115899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:58 devstack sudo[115899]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471" returned: 0 in 0.399s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:58 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:58 devstack sudo[115902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info
Aug 26 03:25:58 devstack sudo[115902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:59 devstack sudo[115902]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:59 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info is being set with open permissions: ugo+rw
Aug 26 03:25:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:25:59 devstack sudo[115905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info
Aug 26 03:25:59 devstack sudo[115905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:25:59 devstack sudo[115905]: pam_unix(sudo:session): session closed for user root
Aug 26 03:25:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.info" returned: 0 in 0.292s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:25:59 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:25:59 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f0cf1d34-2117-4f25-a1cd-e37e067807ca tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-53cc0222-1cce-4de7-8fc8-484df108d471-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-53cc0222-1cce-4de7-8fc8-484df108d471-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-b1c37fab-e99d-4d18-b10b-128c0a8393c5" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-b1c37fab-e99d-4d18-b10b-128c0a8393c5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-53cc0222-1cce-4de7-8fc8-484df108d471" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-53cc0222-1cce-4de7-8fc8-484df108d471" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot 53cc0222-1cce-4de7-8fc8-484df108d471 of volume b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef3ffb-a1ca-4f08-a354-845d126efc68]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:00 devstack sudo[115909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471
Aug 26 03:26:00 devstack sudo[115909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (22127283-5173-407b-95fa-9646eb33920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62f81e3-f314-423c-bce4-b686ad3e51ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62f81e3-f314-423c-bce4-b686ad3e51ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303627983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6ebdb4-51dc-4130-b6b4-cc447515bd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:01Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:00 devstack sudo[115909]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840732b1-0ddf-4547-9e50-aff8322d345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (840732b1-0ddf-4547-9e50-aff8322d345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f95ad3-1418-4046-8922-e4d1915fd2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f95ad3-1418-4046-8922-e4d1915fd2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6ebdb4-51dc-4130-b6b4-cc447515bd02', 'volume_name': 'volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd18365-44b5-4640-96cb-b3600de30274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd18365-44b5-4640-96cb-b3600de30274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe72549-fa5d-44d3-806f-815cead6e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:00 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Volume ba6ebdb4-51dc-4130-b6b4-cc447515bd02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02', 'volume_size': 1}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303627983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6ebdb4-51dc-4130-b6b4-cc447515bd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:01Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Creating volume ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:00 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471" returned: 0 in 0.479s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:00 devstack sudo[115914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 1073741824
Aug 26 03:26:00 devstack sudo[115914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[56792bfd-e552-4481-8943-297d37737417]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:00 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:01 devstack sudo[115916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5
Aug 26 03:26:01 devstack sudo[115916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:01 devstack sudo[115914]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 1073741824" returned: 0 in 0.463s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:01 devstack sudo[115916]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5" returned: 0 in 0.425s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:01 devstack sudo[115924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471
Aug 26 03:26:01 devstack sudo[115924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:01 devstack sudo[115926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02
Aug 26 03:26:01 devstack sudo[115926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:01 devstack sudo[115926]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" returned: 0 in 0.275s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe72549-fa5d-44d3-806f-815cead6e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caaf8f1-219e-4092-8c6c-c985cc4e52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:01 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Volume volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 (ba6ebdb4-51dc-4130-b6b4-cc447515bd02): created successfully
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caaf8f1-219e-4092-8c6c-c985cc4e52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (22127283-5173-407b-95fa-9646eb33920b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:01 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-622b7720-3c72-415e-921c-043d6fc39bb5 tempest-ProjectReaderTests-1670175729 None] Created volume successfully.
Aug 26 03:26:01 devstack sudo[115924]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471" returned: 0 in 0.433s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:01 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:01 devstack sudo[115933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471
Aug 26 03:26:01 devstack sudo[115933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:02 devstack sudo[115933]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5.53cc0222-1cce-4de7-8fc8-484df108d471" returned: 0 in 0.252s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-53cc0222-1cce-4de7-8fc8-484df108d471" released by "_delete_snapshot" :: held 1.723s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-b1c37fab-e99d-4d18-b10b-128c0a8393c5" released by "delete_snapshot" :: held 1.753s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Created reservations ['bf3bf693-33cf-4afa-9b37-debe64b1cf70', '10256128-3899-4398-9462-204e62583107', '0c7868ae-587e-4c16-a146-9ba98d59b126', '61a83634-a757-4489-b719-3296204518a9'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:02 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-37f9f024-0a35-4900-b6e9-38bbb1f14027 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-53cc0222-1cce-4de7-8fc8-484df108d471-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-b1c37fab-e99d-4d18-b10b-128c0a8393c5-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-b1c37fab-e99d-4d18-b10b-128c0a8393c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-b1c37fab-e99d-4d18-b10b-128c0a8393c5" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-b1c37fab-e99d-4d18-b10b-128c0a8393c5" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94c9133-d952-4db9-92c6-543fb31d06e4]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:02 devstack sudo[115937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5
Aug 26 03:26:02 devstack sudo[115937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:02 devstack sudo[115937]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5" returned: 0 in 0.385s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:02 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:02 devstack sudo[115942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5
Aug 26 03:26:02 devstack sudo[115942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Creating offline snapshot 7016b37b-276c-442a-85da-934d6b49287b of volume ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61d474-8791-4777-8ce6-d399231f1ff8]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:03 devstack sudo[115944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02
Aug 26 03:26:03 devstack sudo[115944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:03 devstack sudo[115942]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b1c37fab-e99d-4d18-b10b-128c0a8393c5" returned: 0 in 0.341s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-b1c37fab-e99d-4d18-b10b-128c0a8393c5" released by "delete_volume" :: held 0.790s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Created reservations ['93481eed-44e9-47d2-9923-e494fcb81cb2', 'baac379f-8a54-40f7-be86-6c65b7df8d06', '152e9b56-f957-44cd-95dd-7718803371af', '772b3e92-13b8-401c-9375-23b6ea0a736c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:03 devstack sudo[115949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:03 devstack sudo[115949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:03 devstack sudo[115944]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" returned: 0 in 0.469s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:03 devstack sudo[115952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b 1G
Aug 26 03:26:03 devstack sudo[115952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:03 devstack sudo[115949]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.320s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:26:03 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-8858c7ae-a475-4e5b-8bae-ce50cada645e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-b1c37fab-e99d-4d18-b10b-128c0a8393c5-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:04 devstack sudo[115952]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b 1G" returned: 0 in 0.545s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:04 devstack sudo[115958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b
Aug 26 03:26:04 devstack sudo[115958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (c2aad392-b3b2-4fff-95cd-9d9fd0f69676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbcabbc-724f-4e7e-9a2a-1531f7335f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbcabbc-724f-4e7e-9a2a-1531f7335f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525425138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ce648a-045d-40c4-96f5-f5ed26c4c108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:04Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e9c8bf-6cf4-4c0c-8723-2871cc5bee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e9c8bf-6cf4-4c0c-8723-2871cc5bee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5178a6-76f2-48b3-8535-bc8a4028c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5178a6-76f2-48b3-8535-bc8a4028c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ce648a-045d-40c4-96f5-f5ed26c4c108', 'volume_name': 'volume-52ce648a-045d-40c4-96f5-f5ed26c4c108', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759385dc-527f-4337-bfad-98ff105f9d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759385dc-527f-4337-bfad-98ff105f9d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f39f1fb-17aa-408b-9099-d6b1c6cf7bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:04 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Volume 52ce648a-045d-40c4-96f5-f5ed26c4c108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ce648a-045d-40c4-96f5-f5ed26c4c108', 'volume_size': 1}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:04 devstack sudo[115958]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b" returned: 0 in 0.338s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:04 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b is being set with open permissions: ugo+rw
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:04 devstack sudo[115964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b
Aug 26 03:26:04 devstack sudo[115964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:04 devstack sudo[115964]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b" returned: 0 in 0.269s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:04 devstack sudo[115967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info
Aug 26 03:26:04 devstack sudo[115967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:05 devstack sudo[115967]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info" returned: 0 in 0.308s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:05 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info is being set with open permissions: ugo+rw
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:05 devstack sudo[115970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info
Aug 26 03:26:05 devstack sudo[115970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:05 devstack sudo[115970]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.info" returned: 0 in 0.262s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525425138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ce648a-045d-40c4-96f5-f5ed26c4c108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:04Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Creating volume 52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:05 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:05 devstack sudo[115973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 1073741824
Aug 26 03:26:05 devstack sudo[115973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-21ea18a6-761b-48f4-b344-adbefa1fca85 tempest-ProjectReaderTests-1670175729 None] Create snapshot completed successfully
Aug 26 03:26:05 devstack sudo[115973]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 1073741824" returned: 0 in 0.555s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:05 devstack sudo[115980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108
Aug 26 03:26:05 devstack sudo[115980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:06 devstack sudo[115980]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108" returned: 0 in 0.268s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f39f1fb-17aa-408b-9099-d6b1c6cf7bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ce648a-045d-40c4-96f5-f5ed26c4c108', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af86b973-faef-47dd-9ee8-4c747bc26482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:06 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Volume volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 (52ce648a-045d-40c4-96f5-f5ed26c4c108): created successfully
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af86b973-faef-47dd-9ee8-4c747bc26482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (c2aad392-b3b2-4fff-95cd-9d9fd0f69676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d23b2622-5aaf-4916-bb4b-5183f0ce4177 tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-7016b37b-276c-442a-85da-934d6b49287b-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-7016b37b-276c-442a-85da-934d6b49287b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-7016b37b-276c-442a-85da-934d6b49287b" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-7016b37b-276c-442a-85da-934d6b49287b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Deleting offline snapshot 7016b37b-276c-442a-85da-934d6b49287b of volume ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] snapshot_file for this snap is: volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42b5e0c-aa08-4dc5-8ef7-406b915cafda]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:06 devstack sudo[115983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b
Aug 26 03:26:06 devstack sudo[115983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:06 devstack sudo[115983]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b" returned: 0 in 0.442s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7baa32-b1c7-43fd-8f39-fc5ddf19a9ba]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:07 devstack sudo[115988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02
Aug 26 03:26:07 devstack sudo[115988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:07 devstack sudo[115988]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" returned: 0 in 0.437s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:07 devstack sudo[115993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b
Aug 26 03:26:07 devstack sudo[115993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot 255b1422-fc0e-4b33-8c9b-2095672f2dbc of volume 52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b8c19-a964-4619-a0bd-7d7bc16ec19a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:07 devstack sudo[115995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108
Aug 26 03:26:07 devstack sudo[115995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Flow 'volume_create_manager' (d00af381-78d6-47da-8fba-f66ef33ceb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fdbc74-5ce9-4880-b53f-06294c2982d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fdbc74-5ce9-4880-b53f-06294c2982d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1505699693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cffca47-7ba3-438a-b3b5-6095d54f0c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0357becc55b64ebb9c68b25a03ffd47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:08Z,use_quota=True,user_id='21bdc0aedb2b42b1b1ecb37488c4661b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd39696-7c55-40d1-a300-257849e11bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd39696-7c55-40d1-a300-257849e11bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4e1c5c-d003-4114-ac76-d78091f31151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4e1c5c-d003-4114-ac76-d78091f31151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cffca47-7ba3-438a-b3b5-6095d54f0c5f', 'volume_name': 'volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e704dc68-de52-4f7f-a579-ade61038107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e704dc68-de52-4f7f-a579-ade61038107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10a0b01-d78f-4fb1-a927-78cfac02992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:07 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Volume 1cffca47-7ba3-438a-b3b5-6095d54f0c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f', 'volume_size': 1}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:07 devstack sudo[115993]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b" returned: 0 in 0.491s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:07 devstack sudo[116002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b
Aug 26 03:26:07 devstack sudo[116002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:07 devstack sudo[115995]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108" returned: 0 in 0.435s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:08 devstack sudo[116005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc 1G
Aug 26 03:26:08 devstack sudo[116005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:08 devstack sudo[116002]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02.7016b37b-276c-442a-85da-934d6b49287b" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-7016b37b-276c-442a-85da-934d6b49287b" released by "_delete_snapshot" :: held 1.732s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" released by "delete_snapshot" :: held 1.760s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Created reservations ['70fad1b5-fb62-4711-8c05-edd3701a37c4', '94899c1b-97e2-4e4e-9d04-5227b757f0d7', 'aa2a5f74-8d04-42de-b422-fce8960a996c', '9b795ece-3823-4e84-b597-5123181d743d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Delete snapshot completed successfully.
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-0684042f-e1ef-4274-83d2-f819e794e016 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-7016b37b-276c-442a-85da-934d6b49287b-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:08 devstack sudo[116005]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc 1G" returned: 0 in 0.419s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:08 devstack sudo[116011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc
Aug 26 03:26:08 devstack sudo[116011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-ba6ebdb4-51dc-4130-b6b4-cc447515bd02-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Lock "cinder-ba6ebdb4-51dc-4130-b6b4-cc447515bd02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" acquired by "delete_volume" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[00883c2d-ef12-42a2-adad-254d31976ace]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:08 devstack sudo[116011]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc" returned: 0 in 0.348s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:08 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc is being set with open permissions: ugo+rw
Aug 26 03:26:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:08 devstack sudo[116017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc
Aug 26 03:26:08 devstack sudo[116017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:08 devstack sudo[116016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02
Aug 26 03:26:08 devstack sudo[116016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:09 devstack sudo[116017]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc" returned: 0 in 0.241s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:09 devstack sudo[116023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info
Aug 26 03:26:09 devstack sudo[116023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:09 devstack sudo[116016]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" returned: 0 in 0.352s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:09 devstack sudo[116026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02
Aug 26 03:26:09 devstack sudo[116026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:09 devstack sudo[116023]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info" returned: 0 in 0.253s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:09 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info is being set with open permissions: ugo+rw
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:09 devstack sudo[116029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info
Aug 26 03:26:09 devstack sudo[116029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:09 devstack sudo[116026]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" returned: 0 in 0.255s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-ba6ebdb4-51dc-4130-b6b4-cc447515bd02" released by "delete_volume" :: held 0.673s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Created reservations ['f4037737-5036-4178-99d6-2f123a6ea006', 'e8e4ec7f-56b4-4c32-a0a3-1d57c33eda78', '46278898-03b7-4b1a-ab4c-d0121969f555', '2fa878d2-27a1-41b1-9b35-c85d4fbd2680'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:09 devstack sudo[116034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:09 devstack sudo[116034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:09 devstack sudo[116029]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.info" returned: 0 in 0.257s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1505699693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cffca47-7ba3-438a-b3b5-6095d54f0c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0357becc55b64ebb9c68b25a03ffd47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:08Z,use_quota=True,user_id='21bdc0aedb2b42b1b1ecb37488c4661b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Creating volume 1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:09 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:09 devstack sudo[116036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f 1073741824
Aug 26 03:26:09 devstack sudo[116036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-049d8089-bffa-4aa4-a117-6723a50e7e70 tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:26:09 devstack sudo[116034]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.269s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Deleted volume successfully.
Aug 26 03:26:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-d0197d7a-f6fa-4730-85a2-8b8e8ffbaaee tempest-ProjectReaderTests-1670175729 None] Lock "cinder-ba6ebdb4-51dc-4130-b6b4-cc447515bd02-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:10 devstack sudo[116036]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f 1073741824" returned: 0 in 0.469s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:10 devstack sudo[116043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f
Aug 26 03:26:10 devstack sudo[116043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (f318624b-1715-47c2-8f6d-3d3eaebd3add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd82c32-fcb4-4656-a0b4-c45ca1e3feba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd82c32-fcb4-4656-a0b4-c45ca1e3feba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566878474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a851048b-7875-42c3-bdfc-7c86c2e3e5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:10Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf543ae-7ac6-4eb3-b0ea-2fe9adec2fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf543ae-7ac6-4eb3-b0ea-2fe9adec2fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7803d4ab-c2ce-49e6-8a7f-77d509e9f3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7803d4ab-c2ce-49e6-8a7f-77d509e9f3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a851048b-7875-42c3-bdfc-7c86c2e3e5e3', 'volume_name': 'volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc4c581-7e1a-478d-9bc5-07eecb410cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc4c581-7e1a-478d-9bc5-07eecb410cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f027f-d32a-4d5f-826f-52da59dc0c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Volume a851048b-7875-42c3-bdfc-7c86c2e3e5e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3', 'volume_size': 1}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:10 devstack sudo[116043]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" returned: 0 in 0.252s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566878474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a851048b-7875-42c3-bdfc-7c86c2e3e5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:10Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Creating volume a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:10 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10a0b01-d78f-4fb1-a927-78cfac02992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:10 devstack sudo[116046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 1073741824
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f4c876-1f86-437e-92ff-ddd044b35a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:10 devstack sudo[116046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:10 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Volume volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f (1cffca47-7ba3-438a-b3b5-6095d54f0c5f): created successfully
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f4c876-1f86-437e-92ff-ddd044b35a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Flow 'volume_create_manager' (d00af381-78d6-47da-8fba-f66ef33ceb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-89adbe22-759e-418f-81f2-9cbc0938f95f tempest-SnapshotDependencyTests-1284666055 None] Created volume successfully.
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-255b1422-fc0e-4b33-8c9b-2095672f2dbc-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-255b1422-fc0e-4b33-8c9b-2095672f2dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-52ce648a-045d-40c4-96f5-f5ed26c4c108" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-52ce648a-045d-40c4-96f5-f5ed26c4c108" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-255b1422-fc0e-4b33-8c9b-2095672f2dbc" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-255b1422-fc0e-4b33-8c9b-2095672f2dbc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot 255b1422-fc0e-4b33-8c9b-2095672f2dbc of volume 52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb746153-9591-470d-916e-d8c5b817f14b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:10 devstack sudo[116046]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 1073741824" returned: 0 in 0.445s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:10 devstack sudo[116051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc
Aug 26 03:26:10 devstack sudo[116051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:10 devstack sudo[116054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3
Aug 26 03:26:10 devstack sudo[116054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:11 devstack sudo[116051]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc" returned: 0 in 0.379s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52ce648a-045d-40c4-96f5-f5ed26c4c108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:11 devstack sudo[116054]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" returned: 0 in 0.266s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f027f-d32a-4d5f-826f-52da59dc0c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b0e7f8-3979-4d47-9890-343fe7bbc236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1200f35-e32f-4999-acfb-a5778dbd13a3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Volume volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 (a851048b-7875-42c3-bdfc-7c86c2e3e5e3): created successfully
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b0e7f8-3979-4d47-9890-343fe7bbc236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (f318624b-1715-47c2-8f6d-3d3eaebd3add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3a96bbe3-35a8-4102-82e2-7cc46f2d9e30 tempest-ProjectReaderTests-1670175729 None] Created volume successfully.
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Creating offline snapshot 469aaaeb-9a96-4cb0-a19f-ce173dde6853 of volume 1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[538496eb-c61d-4624-817c-bb2172533d69]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:11 devstack sudo[116060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108
Aug 26 03:26:11 devstack sudo[116060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:11 devstack sudo[116061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f
Aug 26 03:26:11 devstack sudo[116061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:11 devstack sudo[116060]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108" returned: 0 in 0.396s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:11 devstack sudo[116068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc
Aug 26 03:26:11 devstack sudo[116068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:11 devstack sudo[116061]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" returned: 0 in 0.402s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:11 devstack sudo[116073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 1G
Aug 26 03:26:11 devstack sudo[116073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:11 devstack sudo[116068]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:11 devstack sudo[116079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc
Aug 26 03:26:11 devstack sudo[116079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:12 devstack sudo[116073]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 1G" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:12 devstack sudo[116083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853
Aug 26 03:26:12 devstack sudo[116083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:12 devstack sudo[116079]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108.255b1422-fc0e-4b33-8c9b-2095672f2dbc" returned: 0 in 0.265s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-255b1422-fc0e-4b33-8c9b-2095672f2dbc" released by "_delete_snapshot" :: held 1.515s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-52ce648a-045d-40c4-96f5-f5ed26c4c108" released by "delete_snapshot" :: held 1.541s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Created reservations ['3927b9dc-384c-412a-ba0c-8baf353177c3', 'ff44cd5e-dfc9-43e8-b210-63365b549c22', 'dcb8a02e-a09a-4f1f-b874-f7d36a65b510', '793d546b-3454-4507-8732-02e918dc8789'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:12 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-09727830-b109-4aa5-9fb1-efbf5d775c86 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-255b1422-fc0e-4b33-8c9b-2095672f2dbc-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:12 devstack sudo[116083]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:12 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 is being set with open permissions: ugo+rw
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:12 devstack sudo[116089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853
Aug 26 03:26:12 devstack sudo[116089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:12 devstack sudo[116089]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853" returned: 0 in 0.240s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:12 devstack sudo[116092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info
Aug 26 03:26:12 devstack sudo[116092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:12 devstack sudo[116093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:12 devstack sudo[116093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-52ce648a-045d-40c4-96f5-f5ed26c4c108-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-52ce648a-045d-40c4-96f5-f5ed26c4c108-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-52ce648a-045d-40c4-96f5-f5ed26c4c108" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-52ce648a-045d-40c4-96f5-f5ed26c4c108" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:12 devstack sudo[116092]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df467a5b-7213-4d1d-9157-13d14a966224]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info" returned: 0 in 0.287s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:12 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info is being set with open permissions: ugo+rw
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:12 devstack sudo[116093]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.284s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:26:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:26:12 devstack sudo[116099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info
Aug 26 03:26:12 devstack sudo[116099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:13 devstack sudo[116098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108
Aug 26 03:26:13 devstack sudo[116098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:13 devstack sudo[116099]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.info" returned: 0 in 0.238s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.691s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Creating offline snapshot 13730e77-9fc5-463c-920c-28bae594ca8f of volume a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-8cdffc25-d51b-4efe-9362-1c3df4be8b7c tempest-SnapshotDependencyTests-1284666055 None] Create snapshot completed successfully
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94519b4-dceb-4828-b6d4-a1d931351229]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:13 devstack sudo[116098]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108" returned: 0 in 0.372s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:13 devstack sudo[116107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108
Aug 26 03:26:13 devstack sudo[116107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:13 devstack sudo[116106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3
Aug 26 03:26:13 devstack sudo[116106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:13 devstack sudo[116107]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-52ce648a-045d-40c4-96f5-f5ed26c4c108" returned: 0 in 0.249s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-52ce648a-045d-40c4-96f5-f5ed26c4c108" released by "delete_volume" :: held 0.681s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:13 devstack sudo[116106]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" returned: 0 in 0.370s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Created reservations ['1c229871-2952-466b-9026-8409a80e7f71', 'c237e85e-7a30-438d-8e9c-d5d3cd686103', '04e506ea-2f85-444a-852d-c7d5a84be7ff', 'd1a89fb0-a32d-4ace-9efe-b685b95ea19d'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:13 devstack sudo[116115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f 1G
Aug 26 03:26:13 devstack sudo[116115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:13 devstack sudo[116117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:13 devstack sudo[116117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:13 devstack sudo[116117]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.248s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:26:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dcfe58eb-c03f-49f0-8643-f02a1f861854 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-52ce648a-045d-40c4-96f5-f5ed26c4c108-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:14 devstack sudo[116115]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f 1G" returned: 0 in 0.438s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:14 devstack sudo[116123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f
Aug 26 03:26:14 devstack sudo[116123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:14 devstack sudo[116123]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:14 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f is being set with open permissions: ugo+rw
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:14 devstack sudo[116131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f
Aug 26 03:26:14 devstack sudo[116131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (58d092dc-08bd-477e-b762-5c52841dde91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0d5845-5b75-4f00-9225-9330e221b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0d5845-5b75-4f00-9225-9330e221b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454566035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d980874-7788-4de3-ae62-8c6280767164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:14Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0247454-b0a6-4544-ae8d-1dde3d6fa3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0247454-b0a6-4544-ae8d-1dde3d6fa3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2c0847-b1da-4592-8f37-62167cfbee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2c0847-b1da-4592-8f37-62167cfbee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d980874-7788-4de3-ae62-8c6280767164', 'volume_name': 'volume-9d980874-7788-4de3-ae62-8c6280767164', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29fd784-a7ba-4d1b-b4e3-e5b72035656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29fd784-a7ba-4d1b-b4e3-e5b72035656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67882580-1d8a-4b70-ae8c-c03357dfc835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:14 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Volume 9d980874-7788-4de3-ae62-8c6280767164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d980874-7788-4de3-ae62-8c6280767164', 'volume_size': 1}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:14 devstack sudo[116131]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f" returned: 0 in 0.262s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:14 devstack sudo[116134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info
Aug 26 03:26:14 devstack sudo[116134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:14 devstack sudo[116134]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info" returned: 0 in 0.256s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:14 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info is being set with open permissions: ugo+rw
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:14 devstack sudo[116137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info
Aug 26 03:26:14 devstack sudo[116137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Flow 'volume_create_manager' (44b6933d-c319-438d-ac66-83d9e51a93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:14 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9838b800-d983-4325-93d5-130c21bc3724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9838b800-d983-4325-93d5-130c21bc3724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45131a97-240a-4760-a5fb-dedbd73168be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0357becc55b64ebb9c68b25a03ffd47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=469aaaeb-9a96-4cb0-a19f-ce173dde6853,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:15Z,use_quota=True,user_id='21bdc0aedb2b42b1b1ecb37488c4661b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9d8d9f-8b05-4a71-a4dd-b37dd4f0133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9d8d9f-8b05-4a71-a4dd-b37dd4f0133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74f9bfe-821d-4511-ae4f-a33cc5b0a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74f9bfe-821d-4511-ae4f-a33cc5b0a5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45131a97-240a-4760-a5fb-dedbd73168be', 'volume_name': 'volume-45131a97-240a-4760-a5fb-dedbd73168be', 'volume_size': 1, 'snapshot_id': '469aaaeb-9a96-4cb0-a19f-ce173dde6853'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac059b4e-877b-46b4-9593-3001b857e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac059b4e-877b-46b4-9593-3001b857e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752ee93d-7f9c-4e27-a5b8-1b449c75f5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:15 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Volume 45131a97-240a-4760-a5fb-dedbd73168be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45131a97-240a-4760-a5fb-dedbd73168be', 'volume_size': 1, 'snapshot_id': '469aaaeb-9a96-4cb0-a19f-ce173dde6853'}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:15 devstack sudo[116137]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.info" returned: 0 in 0.245s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454566035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d980874-7788-4de3-ae62-8c6280767164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:14Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Creating volume 9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:15 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:15 devstack sudo[116140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 1073741824
Aug 26 03:26:15 devstack sudo[116140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:15 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-b12a453c-785f-465f-9632-0e4457ff136e tempest-ProjectReaderTests-1670175729 None] Create snapshot completed successfully
Aug 26 03:26:15 devstack sudo[116140]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 1073741824" returned: 0 in 0.448s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-13730e77-9fc5-463c-920c-28bae594ca8f-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:15 devstack sudo[116146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164
Aug 26 03:26:15 devstack sudo[116146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Lock "cinder-13730e77-9fc5-463c-920c-28bae594ca8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-13730e77-9fc5-463c-920c-28bae594ca8f" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-13730e77-9fc5-463c-920c-28bae594ca8f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Deleting offline snapshot 13730e77-9fc5-463c-920c-28bae594ca8f of volume a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] snapshot_file for this snap is: volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4adb62-555e-4abe-b303-c85750d9983d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:15 devstack sudo[116148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f
Aug 26 03:26:15 devstack sudo[116148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:15 devstack sudo[116146]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164" returned: 0 in 0.261s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.923s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-quobyte-469aaaeb-9a96-4cb0-a19f-ce173dde6853-45131a97-240a-4760-a5fb-dedbd73168be" by "_create_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67882580-1d8a-4b70-ae8c-c03357dfc835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d980874-7788-4de3-ae62-8c6280767164', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:15 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515162ac-a704-402b-91f6-e386a83e403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-469aaaeb-9a96-4cb0-a19f-ce173dde6853-45131a97-240a-4760-a5fb-dedbd73168be" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Creating volume 45131a97-240a-4760-a5fb-dedbd73168be from snapshot 469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-quobyte-45131a97-240a-4760-a5fb-dedbd73168be" by "_copy_volume_from_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:16 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Volume volume-9d980874-7788-4de3-ae62-8c6280767164 (9d980874-7788-4de3-ae62-8c6280767164): created successfully
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515162ac-a704-402b-91f6-e386a83e403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (58d092dc-08bd-477e-b762-5c52841dde91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-45131a97-240a-4760-a5fb-dedbd73168be" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] snapshot: 469aaaeb-9a96-4cb0-a19f-ce173dde6853, volume: 45131a97-240a-4760-a5fb-dedbd73168be,  {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Aug 26 03:26:16 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-453e81c6-c780-4b9c-a349-febc0c089e52 tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8fcca9-6ace-4fbf-94bd-edc6c139457c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:16 devstack sudo[116148]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:16 devstack sudo[116151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853
Aug 26 03:26:16 devstack sudo[116151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2358f543-81e6-45d6-84a6-388ef1dc3f18]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:16 devstack sudo[116156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3
Aug 26 03:26:16 devstack sudo[116156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:16 devstack sudo[116151]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853" returned: 0 in 0.376s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bb5cb3-800f-4507-a30b-fee8578a35f9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:16 devstack sudo[116161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f
Aug 26 03:26:16 devstack sudo[116161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:16 devstack sudo[116156]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" returned: 0 in 0.450s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:16 devstack sudo[116167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f
Aug 26 03:26:16 devstack sudo[116167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:16 devstack sudo[116161]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" returned: 0 in 0.400s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Creating direct copy from snapshot {{(pid=94326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG cinder.utils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Path /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be not found in is_blk_device check {{(pid=94326) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Aug 26 03:26:16 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:16 devstack sudo[116174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be
Aug 26 03:26:16 devstack sudo[116174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:17 devstack sudo[116167]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f" returned: 0 in 0.350s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:17 devstack sudo[116177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f
Aug 26 03:26:17 devstack sudo[116177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:17 devstack sudo[116177]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3.13730e77-9fc5-463c-920c-28bae594ca8f" returned: 0 in 0.257s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-13730e77-9fc5-463c-920c-28bae594ca8f" released by "_delete_snapshot" :: held 1.534s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" released by "delete_snapshot" :: held 1.558s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Created reservations ['505d327e-3592-43b2-aea1-fc17047f3182', '0c2aba8a-e460-4a5d-8e78-cf3bf8a4fb82', 'b0b293ee-22db-4cdd-9906-c675f74c9a16', '8b0f2609-6938-4fe8-89ba-c40c39e4074b'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:17 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Delete snapshot completed successfully.
Aug 26 03:26:17 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e424e175-8454-4214-a135-436567c3f2dd tempest-ProjectReaderTests-1670175729 None] Lock "cinder-13730e77-9fc5-463c-920c-28bae594ca8f-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-a851048b-7875-42c3-bdfc-7c86c2e3e5e3-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Lock "cinder-a851048b-7875-42c3-bdfc-7c86c2e3e5e3-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:18 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" acquired by "delete_volume" :: waited 0.038s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:18 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[64664b8b-2b9f-4b62-947f-d7a69d8ae2c3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:18 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:18 devstack sudo[116191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3
Aug 26 03:26:18 devstack sudo[116191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:19 devstack sudo[116191]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" returned: 0 in 0.714s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:19 devstack sudo[116196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3
Aug 26 03:26:19 devstack sudo[116196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:19 devstack sudo[116196]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" returned: 0 in 0.573s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-a851048b-7875-42c3-bdfc-7c86c2e3e5e3" released by "delete_volume" :: held 1.412s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Created reservations ['b78cac1f-b03d-4809-b42a-3fb470ed25f8', '487179c2-658e-40aa-8209-6bf08601bbbb', '067626d8-8e27-4066-8e7e-92432af912ae', 'ebba8fb3-5b94-4396-8ef8-3d018f8a0047'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:19 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:20 devstack sudo[116200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:20 devstack sudo[116200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:20 devstack sudo[116200]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:20 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.522s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:20 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:20 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Deleted volume successfully.
Aug 26 03:26:20 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-78cde843-5f6c-4f22-9d63-a9c83bb0589f tempest-ProjectReaderTests-1670175729 None] Lock "cinder-a851048b-7875-42c3-bdfc-7c86c2e3e5e3-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (83b307e2-7d40-4c67-8f33-98df0b548d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88435e4c-b994-4fe3-8465-a5c240f49ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88435e4c-b994-4fe3-8465-a5c240f49ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878685323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815ff38a-55de-480f-9e9d-1286991488a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:21Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3472662-a2cb-4f4e-b591-e43de2c63b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3472662-a2cb-4f4e-b591-e43de2c63b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:21 devstack sudo[116174]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedba450-f046-4876-a631-d83773a78433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedba450-f046-4876-a631-d83773a78433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '815ff38a-55de-480f-9e9d-1286991488a8', 'volume_name': 'volume-815ff38a-55de-480f-9e9d-1286991488a8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511bc681-929f-4ad0-9a7d-40adefca8856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511bc681-929f-4ad0-9a7d-40adefca8856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214f52d8-35e0-4f42-8db5-251e6cfce4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Volume 815ff38a-55de-480f-9e9d-1286991488a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-815ff38a-55de-480f-9e9d-1286991488a8', 'volume_size': 1}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be" returned: 0 in 4.673s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.image.image_utils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be {{(pid=94326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 26 03:26:21 devstack cinder-volume[94326]: INFO cinder.image.image_utils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Converted 1024.00 MB image at 219.11 MB/s
Aug 26 03:26:21 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be is being set with open permissions: ugo+rw
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:21 devstack sudo[116203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be
Aug 26 03:26:21 devstack sudo[116203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:21 devstack sudo[116203]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be" returned: 0 in 0.233s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-45131a97-240a-4760-a5fb-dedbd73168be" released by "_copy_volume_from_snapshot" :: held 5.774s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-469aaaeb-9a96-4cb0-a19f-ce173dde6853-45131a97-240a-4760-a5fb-dedbd73168be" released by "_create_volume_from_snapshot" :: held 5.850s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.885s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.162s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot 6f96f0bc-d96c-412d-b79e-3a8c17b61a88 of volume 9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752ee93d-7f9c-4e27-a5b8-1b449c75f5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45131a97-240a-4760-a5fb-dedbd73168be', 'volume_size': 1, 'snapshot_id': '469aaaeb-9a96-4cb0-a19f-ce173dde6853'}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa80c6a-3c80-4dfc-bc01-04418dd6c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c2a2eb-3c87-4a18-9882-45ad34a80d4e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:21 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Volume volume-45131a97-240a-4760-a5fb-dedbd73168be (45131a97-240a-4760-a5fb-dedbd73168be): created successfully
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa80c6a-3c80-4dfc-bc01-04418dd6c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:21 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Flow 'volume_create_manager' (44b6933d-c319-438d-ac66-83d9e51a93ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:21 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-5b30e727-2e14-421a-8574-1e5dbbeb8d4f tempest-SnapshotDependencyTests-1284666055 None] Created volume successfully.
Aug 26 03:26:22 devstack sudo[116206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164
Aug 26 03:26:22 devstack sudo[116206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:22 devstack sudo[116206]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164" returned: 0 in 0.349s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:22 devstack sudo[116211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 1G
Aug 26 03:26:22 devstack sudo[116211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:22 devstack sudo[116211]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 1G" returned: 0 in 0.386s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d980874-7788-4de3-ae62-8c6280767164 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:22 devstack sudo[116217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d980874-7788-4de3-ae62-8c6280767164 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88
Aug 26 03:26:22 devstack sudo[116217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-469aaaeb-9a96-4cb0-a19f-ce173dde6853-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-469aaaeb-9a96-4cb0-a19f-ce173dde6853-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-quobyte-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-quobyte-469aaaeb-9a96-4cb0-a19f-ce173dde6853" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-469aaaeb-9a96-4cb0-a19f-ce173dde6853" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Deleting offline snapshot 469aaaeb-9a96-4cb0-a19f-ce173dde6853 of volume 1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] snapshot_file for this snap is: volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551af2d-d531-43a7-99e6-b58770d92beb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:22 devstack sudo[116219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853
Aug 26 03:26:22 devstack sudo[116219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:22 devstack sudo[116217]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d980874-7788-4de3-ae62-8c6280767164 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88" returned: 0 in 0.318s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:22 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 is being set with open permissions: ugo+rw
Aug 26 03:26:22 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:22 devstack sudo[116225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88
Aug 26 03:26:22 devstack sudo[116225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:23 devstack sudo[116219]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853" returned: 0 in 0.355s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daeceb0-ec6f-402d-adb9-211b88a8e2c9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:23 devstack sudo[116225]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88" returned: 0 in 0.241s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:23 devstack sudo[116233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info
Aug 26 03:26:23 devstack sudo[116233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:23 devstack sudo[116232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f
Aug 26 03:26:23 devstack sudo[116232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:23 devstack sudo[116233]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:23 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info is being set with open permissions: ugo+rw
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:23 devstack sudo[116239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info
Aug 26 03:26:23 devstack sudo[116239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:23 devstack sudo[116232]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" returned: 0 in 0.540s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:23 devstack sudo[116243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853
Aug 26 03:26:23 devstack sudo[116243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:23 devstack sudo[116239]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.info" returned: 0 in 0.269s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878685323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815ff38a-55de-480f-9e9d-1286991488a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:21Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Creating volume 815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:23 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:23 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:23 devstack sudo[116245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 1073741824
Aug 26 03:26:23 devstack sudo[116245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:23 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-14bb533d-5681-4550-a659-2e24e589ecbf tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:26:24 devstack sudo[116243]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853" returned: 0 in 0.348s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:24 devstack sudo[116253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853
Aug 26 03:26:24 devstack sudo[116253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-6f96f0bc-d96c-412d-b79e-3a8c17b61a88-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-6f96f0bc-d96c-412d-b79e-3a8c17b61a88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-9d980874-7788-4de3-ae62-8c6280767164" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-9d980874-7788-4de3-ae62-8c6280767164" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-6f96f0bc-d96c-412d-b79e-3a8c17b61a88" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-6f96f0bc-d96c-412d-b79e-3a8c17b61a88" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot 6f96f0bc-d96c-412d-b79e-3a8c17b61a88 of volume 9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:24 devstack sudo[116245]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 1073741824" returned: 0 in 0.499s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae726322-42be-48d0-b06b-ef01bfe3457e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:24 devstack sudo[116253]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f.469aaaeb-9a96-4cb0-a19f-ce173dde6853" returned: 0 in 0.263s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-469aaaeb-9a96-4cb0-a19f-ce173dde6853" released by "_delete_snapshot" :: held 1.622s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" released by "delete_snapshot" :: held 1.649s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:24 devstack sudo[116258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8
Aug 26 03:26:24 devstack sudo[116258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:24 devstack sudo[116257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88
Aug 26 03:26:24 devstack sudo[116257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Created reservations ['bccfd703-132b-488c-9530-0872f97cb085', 'c5bfee2e-b26d-44d8-8433-b08ced87c471', '92b680c0-1e2d-4196-911f-2bd38838a6ec', 'cf572b5e-e631-4d98-9e94-0cf2c47d01e7'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Delete snapshot completed successfully.
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-2233ab1d-abf3-499d-8a68-060419ae38e1 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-469aaaeb-9a96-4cb0-a19f-ce173dde6853-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:24 devstack sudo[116258]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8" returned: 0 in 0.270s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214f52d8-35e0-4f42-8db5-251e6cfce4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-815ff38a-55de-480f-9e9d-1286991488a8', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43292523-0cc4-44da-ac45-ccacfcb39273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:24 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Volume volume-815ff38a-55de-480f-9e9d-1286991488a8 (815ff38a-55de-480f-9e9d-1286991488a8): created successfully
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43292523-0cc4-44da-ac45-ccacfcb39273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (83b307e2-7d40-4c67-8f33-98df0b548d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:24 devstack sudo[116257]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88" returned: 0 in 0.387s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d980874-7788-4de3-ae62-8c6280767164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:24 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ec671df4-ad1d-478c-93c4-5bb256d2f869 tempest-ProjectReaderTests-1670175729 None] Created volume successfully.
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eba620-c385-4df5-be49-ed9e09e3736d]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:24 devstack sudo[116265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164
Aug 26 03:26:24 devstack sudo[116265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-1cffca47-7ba3-438a-b3b5-6095d54f0c5f-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-1cffca47-7ba3-438a-b3b5-6095d54f0c5f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-quobyte-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbf737d-ee5a-4ba7-94ab-c06dd962768e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:24 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:25 devstack sudo[116265]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:25 devstack sudo[116267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f
Aug 26 03:26:25 devstack sudo[116267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164" returned: 0 in 0.362s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:25 devstack sudo[116272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88
Aug 26 03:26:25 devstack sudo[116272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:25 devstack sudo[116267]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" returned: 0 in 0.382s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:25 devstack sudo[116280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f
Aug 26 03:26:25 devstack sudo[116280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:25 devstack sudo[116272]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88" returned: 0 in 0.367s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:25 devstack sudo[116282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88
Aug 26 03:26:25 devstack sudo[116282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Creating offline snapshot 84612b87-bb39-4824-bcbb-91744ecc0e54 of volume 815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a3069-57cc-4aff-bf58-55e07d9f34eb]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:25 devstack sudo[116280]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" returned: 0 in 0.305s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-1cffca47-7ba3-438a-b3b5-6095d54f0c5f" released by "delete_volume" :: held 0.747s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Created reservations ['45477eea-4de6-477d-bb2f-e403eb26560e', '1f10072e-2959-4977-807d-baf455ad00d2', 'a4fd69f9-489c-4f6a-beb8-5a106b900104', '59788ee6-42c7-406a-bc10-880ee442d0cf'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:25 devstack sudo[116282]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:25 devstack sudo[116285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8
Aug 26 03:26:25 devstack sudo[116285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164.6f96f0bc-d96c-412d-b79e-3a8c17b61a88" returned: 0 in 0.297s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-6f96f0bc-d96c-412d-b79e-3a8c17b61a88" released by "_delete_snapshot" :: held 1.510s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-9d980874-7788-4de3-ae62-8c6280767164" released by "delete_snapshot" :: held 1.546s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:25 devstack sudo[116288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:25 devstack sudo[116288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Created reservations ['e522469d-5570-4d5a-a2ce-97d8036d52f9', 'e788e468-865c-4267-b4e7-61ec7298cb2f', 'b9c818d5-c90d-4a09-ba61-8a2a8606915b', 'af0af246-d65d-4f13-a8f1-38b0051c4bc5'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:25 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:26:25 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-6da1a184-06f7-4bdb-9480-7a7cc8481a55 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-6f96f0bc-d96c-412d-b79e-3a8c17b61a88-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:26 devstack sudo[116285]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8" returned: 0 in 0.401s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-45131a97-240a-4760-a5fb-dedbd73168be-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:26 devstack sudo[116293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 1G
Aug 26 03:26:26 devstack sudo[116293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-45131a97-240a-4760-a5fb-dedbd73168be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "cinder-quobyte-45131a97-240a-4760-a5fb-dedbd73168be" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-45131a97-240a-4760-a5fb-dedbd73168be" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:26 devstack sudo[116288]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.304s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:26 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Deleted volume successfully.
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44b5ddb-2c3f-4364-9f16-f6d56a3e1455]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4fe170c1-428d-4186-bee5-612915155ec9 tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-1cffca47-7ba3-438a-b3b5-6095d54f0c5f-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:26 devstack sudo[116296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be
Aug 26 03:26:26 devstack sudo[116296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-9d980874-7788-4de3-ae62-8c6280767164-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Lock "cinder-9d980874-7788-4de3-ae62-8c6280767164-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-9d980874-7788-4de3-ae62-8c6280767164" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-9d980874-7788-4de3-ae62-8c6280767164" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88379c0-a660-4e76-b7a4-1e635d265d96]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack sudo[116293]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 1G" returned: 0 in 0.488s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-815ff38a-55de-480f-9e9d-1286991488a8 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack sudo[116304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-815ff38a-55de-480f-9e9d-1286991488a8 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54
Aug 26 03:26:26 devstack sudo[116304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack sudo[116296]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be" returned: 0 in 0.452s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack sudo[116302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164
Aug 26 03:26:26 devstack sudo[116302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack sudo[116308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be
Aug 26 03:26:26 devstack sudo[116308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack sudo[116304]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-815ff38a-55de-480f-9e9d-1286991488a8 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54" returned: 0 in 0.354s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 is being set with open permissions: ugo+rw
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack sudo[116302]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack sudo[116308]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164" returned: 0 in 0.391s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:26 devstack sudo[116318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54
Aug 26 03:26:26 devstack sudo[116318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-45131a97-240a-4760-a5fb-dedbd73168be" returned: 0 in 0.286s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-quobyte-45131a97-240a-4760-a5fb-dedbd73168be" released by "delete_volume" :: held 0.789s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:26 devstack sudo[116320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164
Aug 26 03:26:26 devstack sudo[116320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:26 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Created reservations ['ad878277-8fa0-4fe6-8992-bcb8b751abe3', 'c4781565-b83b-4b4f-81a9-b09ff89197b9', 'fb5a8e43-0285-42fd-98e1-5cc419107ca4', '972174be-a56d-481b-b0cf-0695f832d33f'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:27 devstack sudo[116322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:27 devstack sudo[116322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:27 devstack sudo[116318]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54" returned: 0 in 0.263s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:27 devstack sudo[116320]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9d980874-7788-4de3-ae62-8c6280767164" returned: 0 in 0.257s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-9d980874-7788-4de3-ae62-8c6280767164" released by "delete_volume" :: held 0.709s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:27 devstack sudo[116326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info
Aug 26 03:26:27 devstack sudo[116326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Created reservations ['27011101-c3d2-4141-88a3-1151f81832c1', '3849f1cb-d496-4a3a-a8fb-56a9e1d4f08b', '4b91d5b7-6e44-4f72-b5a1-3772e0b12598', 'fcc58d40-6356-4fb9-a388-3963513bf453'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:27 devstack sudo[116322]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.278s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Deleted volume successfully.
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-eaa5a9e0-844c-4b3c-b1f1-4330be6673bb tempest-SnapshotDependencyTests-1284666055 None] Lock "cinder-45131a97-240a-4760-a5fb-dedbd73168be-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:27 devstack sudo[116329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:27 devstack sudo[116329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:27 devstack sudo[116326]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info" returned: 0 in 0.311s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:27 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info is being set with open permissions: ugo+rw
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:27 devstack sudo[116332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info
Aug 26 03:26:27 devstack sudo[116332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:27 devstack sudo[116329]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.277s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-de401fbe-0b05-4ee4-a8cd-c1530f465dee tempest-ProjectMemberTests-1509217531 None] Lock "cinder-9d980874-7788-4de3-ae62-8c6280767164-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:27 devstack sudo[116332]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.info" returned: 0 in 0.287s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:27 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:27 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-d5e77dda-08cf-4fa3-a4e1-a2298498abf4 tempest-ProjectReaderTests-1670175729 None] Create snapshot completed successfully
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (c86370db-c9c0-404f-afc0-9214f371bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb97aac-40f0-42e4-b2b7-a6ae84db33cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb97aac-40f0-42e4-b2b7-a6ae84db33cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220392299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c7711c-8d9e-49f8-bcdd-e3838bc32d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:28Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce054007-f9de-4065-93e6-728fb962919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce054007-f9de-4065-93e6-728fb962919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46352950-8b2d-454c-9975-ebe343fa39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46352950-8b2d-454c-9975-ebe343fa39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c7711c-8d9e-49f8-bcdd-e3838bc32d21', 'volume_name': 'volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21400e36-1018-49d4-9635-213bb1dec654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21400e36-1018-49d4-9635-213bb1dec654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a28366-32c0-4986-acd1-98bac196379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Volume 42c7711c-8d9e-49f8-bcdd-e3838bc32d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21', 'volume_size': 1}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220392299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c7711c-8d9e-49f8-bcdd-e3838bc32d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:28Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Creating volume 42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:28 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:28 devstack sudo[116336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 1073741824
Aug 26 03:26:28 devstack sudo[116336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:28 devstack sudo[116336]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 1073741824" returned: 0 in 0.431s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:28 devstack sudo[116342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21
Aug 26 03:26:28 devstack sudo[116342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-84612b87-bb39-4824-bcbb-91744ecc0e54-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-84612b87-bb39-4824-bcbb-91744ecc0e54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-815ff38a-55de-480f-9e9d-1286991488a8" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:28 devstack sudo[116342]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-815ff38a-55de-480f-9e9d-1286991488a8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-84612b87-bb39-4824-bcbb-91744ecc0e54" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" returned: 0 in 0.289s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-84612b87-bb39-4824-bcbb-91744ecc0e54" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Deleting offline snapshot 84612b87-bb39-4824-bcbb-91744ecc0e54 of volume 815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] snapshot_file for this snap is: volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a28366-32c0-4986-acd1-98bac196379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02be9d1-ffc2-4a66-a0c5-cc601ab1fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4116c528-3c5a-4b4e-9cd0-d97428a7a051]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:28 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Volume volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 (42c7711c-8d9e-49f8-bcdd-e3838bc32d21): created successfully
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02be9d1-ffc2-4a66-a0c5-cc601ab1fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:28 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (c86370db-c9c0-404f-afc0-9214f371bacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:29 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-ec583d83-ce69-4de7-8da2-99174a1a0a31 tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:26:29 devstack sudo[116346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54
Aug 26 03:26:29 devstack sudo[116346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:29 devstack sudo[116346]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54" returned: 0 in 0.372s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:29 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-815ff38a-55de-480f-9e9d-1286991488a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:29 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77beeab-1642-4f2b-9b69-9b1ab708e66e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:29 devstack sudo[116351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8
Aug 26 03:26:29 devstack sudo[116351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:29 devstack sudo[116351]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8" returned: 0 in 0.395s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:29 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:29 devstack sudo[116357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54
Aug 26 03:26:29 devstack sudo[116357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:30 devstack sudo[116357]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54" returned: 0 in 0.340s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:30 devstack sudo[116363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54
Aug 26 03:26:30 devstack sudo[116363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot a6a91257-dd12-4f20-b511-5aa0a18331e7 of volume 42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8907641d-b4ea-4ecd-b1bf-716e5f35f899]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:30 devstack sudo[116363]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8.84612b87-bb39-4824-bcbb-91744ecc0e54" returned: 0 in 0.262s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-84612b87-bb39-4824-bcbb-91744ecc0e54" released by "_delete_snapshot" :: held 1.476s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-815ff38a-55de-480f-9e9d-1286991488a8" released by "delete_snapshot" :: held 1.505s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:30 devstack sudo[116366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21
Aug 26 03:26:30 devstack sudo[116366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Created reservations ['fcad09b0-48e5-40dc-9d02-3b15b4691ad7', 'eb6dee5b-b2a0-431b-b035-6b50b3b13ea9', '53b55dba-f0c0-4647-ab8d-c81749c5614c', '0af8cb03-9ddf-4ffc-a21a-768721d85efb'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:30 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Delete snapshot completed successfully.
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-68cb031f-07ed-46a5-a462-06b7c6bd36c1 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-84612b87-bb39-4824-bcbb-91744ecc0e54-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:30 devstack sudo[116366]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" returned: 0 in 0.421s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:30 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:30 devstack sudo[116372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 1G
Aug 26 03:26:30 devstack sudo[116372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-815ff38a-55de-480f-9e9d-1286991488a8-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-815ff38a-55de-480f-9e9d-1286991488a8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-815ff38a-55de-480f-9e9d-1286991488a8" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-815ff38a-55de-480f-9e9d-1286991488a8" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51e53e-4448-4209-85ac-57b51b6d9fc7]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:31 devstack sudo[116372]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 1G" returned: 0 in 0.486s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:31 devstack sudo[116378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7
Aug 26 03:26:31 devstack sudo[116378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:31 devstack sudo[116377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8
Aug 26 03:26:31 devstack sudo[116377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:31 devstack sudo[116378]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7" returned: 0 in 0.371s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:31 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 is being set with open permissions: ugo+rw
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:31 devstack sudo[116377]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:31 devstack sudo[116389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7
Aug 26 03:26:31 devstack sudo[116389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:31 devstack sudo[116390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8
Aug 26 03:26:31 devstack sudo[116390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:31 devstack sudo[116390]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-815ff38a-55de-480f-9e9d-1286991488a8" returned: 0 in 0.302s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-815ff38a-55de-480f-9e9d-1286991488a8" released by "delete_volume" :: held 0.803s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:31 devstack sudo[116389]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7" returned: 0 in 0.358s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:31 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:32 devstack sudo[116395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info
Aug 26 03:26:32 devstack sudo[116395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Created reservations ['427c9044-5995-48c6-91eb-e79647fc688d', '8a1767bf-bd45-4eb4-92ef-c8c18347f678', '053b30ac-8e12-4838-8bf9-6fc69be35cff', '947cfaa1-5ac8-4d2e-9998-235e7f53b731'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:32 devstack sudo[116397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:32 devstack sudo[116397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:32 devstack sudo[116395]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:32 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info is being set with open permissions: ugo+rw
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:32 devstack sudo[116400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info
Aug 26 03:26:32 devstack sudo[116400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:32 devstack sudo[116397]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.258s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Deleted volume successfully.
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-dd1ddef2-acd0-4947-b58e-2b99e0585ec7 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-815ff38a-55de-480f-9e9d-1286991488a8-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:32 devstack sudo[116400]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.info" returned: 0 in 0.321s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:32 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-be8eef2b-1dc2-45c7-ab03-adbf82619e00 tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (708110cd-22ab-4d7c-9655-2a733dc63703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5ce588-0ad4-4d9e-b660-a6eeaec781ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5ce588-0ad4-4d9e-b660-a6eeaec781ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659668807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062cd035-9fb7-4b6b-9d73-7bc8f30e314a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:33Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2338616-5fd8-4fe2-ba04-7d2ab600a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2338616-5fd8-4fe2-ba04-7d2ab600a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7359acf8-0532-4679-8caa-279cf61d6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7359acf8-0532-4679-8caa-279cf61d6376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062cd035-9fb7-4b6b-9d73-7bc8f30e314a', 'volume_name': 'volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a4cb31-1f83-47d0-bbac-297ad41adaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a4cb31-1f83-47d0-bbac-297ad41adaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a97bff-4ca7-48b4-a6f7-1b06bfa0d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:32 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Volume 062cd035-9fb7-4b6b-9d73-7bc8f30e314a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a', 'volume_size': 1}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659668807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062cd035-9fb7-4b6b-9d73-7bc8f30e314a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:33Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Creating volume 062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:32 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:32 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:32 devstack sudo[116404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a 1073741824
Aug 26 03:26:32 devstack sudo[116404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:33 devstack sudo[116404]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a 1073741824" returned: 0 in 0.411s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:33 devstack sudo[116411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a
Aug 26 03:26:33 devstack sudo[116411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-a6a91257-dd12-4f20-b511-5aa0a18331e7-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-a6a91257-dd12-4f20-b511-5aa0a18331e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-a6a91257-dd12-4f20-b511-5aa0a18331e7" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-a6a91257-dd12-4f20-b511-5aa0a18331e7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot a6a91257-dd12-4f20-b511-5aa0a18331e7 of volume 42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[40403c56-863e-4941-89a2-e16af875f954]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:33 devstack sudo[116411]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" returned: 0 in 0.314s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a97bff-4ca7-48b4-a6f7-1b06bfa0d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0182ff6-cffc-4c0e-8327-6496107df493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:33 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Volume volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a (062cd035-9fb7-4b6b-9d73-7bc8f30e314a): created successfully
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0182ff6-cffc-4c0e-8327-6496107df493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:33 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (708110cd-22ab-4d7c-9655-2a733dc63703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:33 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-f79c024e-6254-42d5-9830-c23810d8c5f8 tempest-ProjectReaderTests-1670175729 None] Created volume successfully.
Aug 26 03:26:33 devstack sudo[116414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7
Aug 26 03:26:33 devstack sudo[116414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Creating offline snapshot 26fba3b5-3bfb-49e8-8880-c35b3de042d7 of volume 062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e372702-32b6-4543-85b9-082734db7e4a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:34 devstack sudo[116414]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7" returned: 0 in 0.436s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[79183c93-848f-47c3-99ac-ebc009c1575a]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:34 devstack sudo[116419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a
Aug 26 03:26:34 devstack sudo[116419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:34 devstack sudo[116420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21
Aug 26 03:26:34 devstack sudo[116420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:34 devstack sudo[116419]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" returned: 0 in 0.432s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:34 devstack sudo[116430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 1G
Aug 26 03:26:34 devstack sudo[116430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:34 devstack sudo[116420]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" returned: 0 in 0.440s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:34 devstack sudo[116432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7
Aug 26 03:26:34 devstack sudo[116432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:34 devstack sudo[116432]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7" returned: 0 in 0.359s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:34 devstack sudo[116430]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 1G" returned: 0 in 0.422s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:34 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:34 devstack sudo[116442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7
Aug 26 03:26:34 devstack sudo[116442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:34 devstack sudo[116443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7
Aug 26 03:26:34 devstack sudo[116443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:35 devstack sudo[116442]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21.a6a91257-dd12-4f20-b511-5aa0a18331e7" returned: 0 in 0.248s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-a6a91257-dd12-4f20-b511-5aa0a18331e7" released by "_delete_snapshot" :: held 1.586s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" released by "delete_snapshot" :: held 1.614s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:35 devstack sudo[116443]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7" returned: 0 in 0.303s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:35 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 is being set with open permissions: ugo+rw
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:35 devstack sudo[116451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7
Aug 26 03:26:35 devstack sudo[116451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Created reservations ['7a3ac715-457c-4e2b-8463-dfe5172af4fd', '5a9a0e73-5c07-42aa-964d-100129e96ada', '37697e5b-4ac1-42f0-918a-d157c364a23c', '2fa09f3e-3223-4b4a-95c2-8e7642c8a86f'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:35 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-199f4a31-1d1d-4fc1-830c-cea03692cfa2 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-a6a91257-dd12-4f20-b511-5aa0a18331e7-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:35 devstack sudo[116451]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7" returned: 0 in 0.323s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:35 devstack sudo[116454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info
Aug 26 03:26:35 devstack sudo[116454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-42c7711c-8d9e-49f8-bcdd-e3838bc32d21-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-42c7711c-8d9e-49f8-bcdd-e3838bc32d21-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" acquired by "delete_volume" :: waited 0.021s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea8fc42-20fe-4d3b-9b8e-4a5972bdd51e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:35 devstack sudo[116454]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info" returned: 0 in 0.299s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:35 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info is being set with open permissions: ugo+rw
Aug 26 03:26:35 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:35 devstack sudo[116458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info
Aug 26 03:26:35 devstack sudo[116458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:35 devstack sudo[116457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21
Aug 26 03:26:35 devstack sudo[116457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:36 devstack sudo[116458]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.info" returned: 0 in 0.268s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-31ff7101-23de-4639-8e88-8e74f347a8d3 tempest-ProjectReaderTests-1670175729 None] Create snapshot completed successfully
Aug 26 03:26:36 devstack sudo[116457]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" returned: 0 in 0.384s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:36 devstack sudo[116465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21
Aug 26 03:26:36 devstack sudo[116465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:36 devstack sudo[116465]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" returned: 0 in 0.274s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-42c7711c-8d9e-49f8-bcdd-e3838bc32d21" released by "delete_volume" :: held 0.726s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Created reservations ['65275960-c332-4227-b26b-9a91fcc148d7', 'a85f5be7-06ae-4101-a6c4-c60fc0799585', 'a0e4787a-3209-4cf9-9ef9-6e3f072db022', 'ec038922-580f-4adc-84ec-f52098142027'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:36 devstack sudo[116469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:36 devstack sudo[116469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:36 devstack sudo[116469]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.250s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:36 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:26:36 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-c0c5f656-424e-4e7e-8fa0-085de1afafb1 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-42c7711c-8d9e-49f8-bcdd-e3838bc32d21-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-26fba3b5-3bfb-49e8-8880-c35b3de042d7-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-26fba3b5-3bfb-49e8-8880-c35b3de042d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-26fba3b5-3bfb-49e8-8880-c35b3de042d7" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-26fba3b5-3bfb-49e8-8880-c35b3de042d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Deleting offline snapshot 26fba3b5-3bfb-49e8-8880-c35b3de042d7 of volume 062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] snapshot_file for this snap is: volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[be582994-8f30-4d83-bbbd-e939402844c3]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (1308cd9e-7128-4d33-aacd-e9d56dccbe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd236dff-5e4a-44c2-8850-8c80b8e05d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd236dff-5e4a-44c2-8850-8c80b8e05d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880042223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0379367-eb8d-44a4-92da-36befe227e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:37Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f49e3cb-e0f5-4831-a231-cdb4bf98fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f49e3cb-e0f5-4831-a231-cdb4bf98fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f369b2a9-25a9-4414-85e9-6f61bcc111a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f369b2a9-25a9-4414-85e9-6f61bcc111a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0379367-eb8d-44a4-92da-36befe227e78', 'volume_name': 'volume-c0379367-eb8d-44a4-92da-36befe227e78', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d62d223-176e-4335-965c-ed230dcf4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:37 devstack sudo[116472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7
Aug 26 03:26:37 devstack sudo[116472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d62d223-176e-4335-965c-ed230dcf4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fd621e-8a59-49e9-9c24-43fedc720137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:37 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Volume c0379367-eb8d-44a4-92da-36befe227e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0379367-eb8d-44a4-92da-36befe227e78', 'volume_size': 1}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880042223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0379367-eb8d-44a4-92da-36befe227e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af2b85537b1c423bbf3af22d07b6162a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:37Z,use_quota=True,user_id='69c77c89ff914cf5a8ca61f7f33e0520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Creating volume c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:37 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:37 devstack sudo[116474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 1073741824
Aug 26 03:26:37 devstack sudo[116474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:37 devstack sudo[116472]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7" returned: 0 in 0.422s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dbd124-f985-4904-80de-2febb89b7570]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:37 devstack sudo[116482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a
Aug 26 03:26:37 devstack sudo[116482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:37 devstack sudo[116474]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:37 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 1073741824" returned: 0 in 0.494s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:38 devstack sudo[116485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78
Aug 26 03:26:38 devstack sudo[116485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:38 devstack sudo[116482]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" returned: 0 in 0.423s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:38 devstack sudo[116490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7
Aug 26 03:26:38 devstack sudo[116490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:38 devstack sudo[116485]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78" returned: 0 in 0.282s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3fd621e-8a59-49e9-9c24-43fedc720137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0379367-eb8d-44a4-92da-36befe227e78', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621af431-9545-4524-b3de-b0b22b9af2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=174,cinder:DELETE=19,cinder:UPDATE=223,cinder:INSERT=62 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:26:38 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Volume volume-c0379367-eb8d-44a4-92da-36befe227e78 (c0379367-eb8d-44a4-92da-36befe227e78): created successfully
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621af431-9545-4524-b3de-b0b22b9af2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Flow 'volume_create_manager' (1308cd9e-7128-4d33-aacd-e9d56dccbe31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-6264aede-ef81-4fe1-814f-b8a266a0957b tempest-ProjectMemberTests-1509217531 None] Created volume successfully.
Aug 26 03:26:38 devstack sudo[116490]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7" returned: 0 in 0.380s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:38 devstack sudo[116496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7
Aug 26 03:26:38 devstack sudo[116496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:38 devstack sudo[116496]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a.26fba3b5-3bfb-49e8-8880-c35b3de042d7" returned: 0 in 0.255s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-26fba3b5-3bfb-49e8-8880-c35b3de042d7" released by "_delete_snapshot" :: held 1.581s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" released by "delete_snapshot" :: held 1.612s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Created reservations ['5613b1fb-8ad5-4223-bd22-cf8c49f447c1', 'e2e15b48-3121-4710-86fd-22f71b53cec7', '523be238-a72b-4369-bfec-b075bb0c4f53', 'ec27ac24-984a-489c-b032-963d23a56f65'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:38 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Delete snapshot completed successfully.
Aug 26 03:26:38 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4bfb44b4-6d86-4358-98a9-6bf075248ac2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-26fba3b5-3bfb-49e8-8880-c35b3de042d7-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-062cd035-9fb7-4b6b-9d73-7bc8f30e314a-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-062cd035-9fb7-4b6b-9d73-7bc8f30e314a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:UPDATE=223,cinder:SELECT=182,cinder:INSERT=61,cinder:DELETE=19 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d225abf3-468d-4044-9f36-b2d6df65fc4b]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Creating offline snapshot f060b3f0-0c8f-424a-8acc-871721570fe4 of volume c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbda446-5f08-4fa7-b44b-491c3d1808b0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:39 devstack sudo[116500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a
Aug 26 03:26:39 devstack sudo[116500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:39 devstack sudo[116501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78
Aug 26 03:26:39 devstack sudo[116501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:39 devstack sudo[116500]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" returned: 0 in 0.365s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:39 devstack sudo[116509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a
Aug 26 03:26:39 devstack sudo[116509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:39 devstack sudo[116501]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78" returned: 0 in 0.366s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:39 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:39 devstack sudo[116512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 1G
Aug 26 03:26:39 devstack sudo[116512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:40 devstack sudo[116509]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" returned: 0 in 0.250s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-062cd035-9fb7-4b6b-9d73-7bc8f30e314a" released by "delete_volume" :: held 0.679s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Created reservations ['eb92cce8-d480-4b9e-80df-4588ae0c25fb', '592a26e2-f60c-4850-9e40-37ec5154f128', 'f0262067-7f64-4b1b-aab0-72a1a1c83f83', 'f16ce221-d691-4cca-bccb-cce005dd1a17'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:40 devstack sudo[116518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:40 devstack sudo[116518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:40 devstack sudo[116512]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 1G" returned: 0 in 0.393s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0379367-eb8d-44a4-92da-36befe227e78 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:40 devstack sudo[116520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0379367-eb8d-44a4-92da-36befe227e78 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4
Aug 26 03:26:40 devstack sudo[116520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:40 devstack sudo[116518]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.249s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:40 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Deleted volume successfully.
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-836132d2-5142-4359-a1f0-b59cd961fff5 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-062cd035-9fb7-4b6b-9d73-7bc8f30e314a-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:40 devstack sudo[116520]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0379367-eb8d-44a4-92da-36befe227e78 -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4" returned: 0 in 0.311s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:40 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 is being set with open permissions: ugo+rw
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:40 devstack sudo[116526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4
Aug 26 03:26:40 devstack sudo[116526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:40 devstack sudo[116526]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:40 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:40 devstack sudo[116529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info
Aug 26 03:26:40 devstack sudo[116529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (f74ed59e-5829-4a6d-8724-e055e15aa7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61df6e7-9eb8-4ffd-b88e-261faac38f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61df6e7-9eb8-4ffd-b88e-261faac38f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129093260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33dd7de-f206-41d5-90ef-349124a73ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:41Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145aefb-3342-4303-99be-63a56bb8e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145aefb-3342-4303-99be-63a56bb8e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed033ba-69bc-4bc9-8ddc-6bc2c0f711a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed033ba-69bc-4bc9-8ddc-6bc2c0f711a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33dd7de-f206-41d5-90ef-349124a73ceb', 'volume_name': 'volume-b33dd7de-f206-41d5-90ef-349124a73ceb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16c0dbd-c407-45e2-b2f8-a62de9a9f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16c0dbd-c407-45e2-b2f8-a62de9a9f23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961523a6-bee8-467b-9b67-675b599c0d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:41 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Volume b33dd7de-f206-41d5-90ef-349124a73ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33dd7de-f206-41d5-90ef-349124a73ceb', 'volume_size': 1}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:41 devstack sudo[116529]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:41 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info is being set with open permissions: ugo+rw
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:41 devstack sudo[116532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info
Aug 26 03:26:41 devstack sudo[116532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:41 devstack sudo[116532]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.info" returned: 0 in 0.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-129093260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33dd7de-f206-41d5-90ef-349124a73ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459d4134defb408f993e3ddd7018a8ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:26:41Z,use_quota=True,user_id='4dd7d422bdd642b79aa881da66750281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Creating volume b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:26:41 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:41 devstack sudo[116535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb 1073741824
Aug 26 03:26:41 devstack sudo[116535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:41 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-cae212c7-d97b-45ea-b40b-fb3a7a51a3c1 tempest-ProjectMemberTests-1509217531 None] Create snapshot completed successfully
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-f060b3f0-0c8f-424a-8acc-871721570fe4-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-f060b3f0-0c8f-424a-8acc-871721570fe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-c0379367-eb8d-44a4-92da-36befe227e78" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-c0379367-eb8d-44a4-92da-36befe227e78" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-f060b3f0-0c8f-424a-8acc-871721570fe4" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-f060b3f0-0c8f-424a-8acc-871721570fe4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Deleting offline snapshot f060b3f0-0c8f-424a-8acc-871721570fe4 of volume c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] snapshot_file for this snap is: volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba4357-af86-45fd-ae75-db0e57dd843e]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:41 devstack sudo[116535]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb 1073741824" returned: 0 in 0.443s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:41 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:41 devstack sudo[116542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb
Aug 26 03:26:41 devstack sudo[116542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:42 devstack sudo[116541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4
Aug 26 03:26:42 devstack sudo[116541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:42 devstack sudo[116542]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb" returned: 0 in 0.246s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961523a6-bee8-467b-9b67-675b599c0d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33dd7de-f206-41d5-90ef-349124a73ceb', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d430e72f-9bcd-489c-bf5d-bd6f9a583ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:26:42 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Volume volume-b33dd7de-f206-41d5-90ef-349124a73ceb (b33dd7de-f206-41d5-90ef-349124a73ceb): created successfully
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d430e72f-9bcd-489c-bf5d-bd6f9a583ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Flow 'volume_create_manager' (f74ed59e-5829-4a6d-8724-e055e15aa7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:26:42 devstack sudo[116541]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:42 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-71e5febe-bcea-4217-906d-8af1400b0feb tempest-ProjectReaderTests-1670175729 None] Created volume successfully.
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4" returned: 0 in 0.366s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0379367-eb8d-44a4-92da-36befe227e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[71acc610-885a-409b-af01-019f3d0d6180]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:42 devstack sudo[116549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78
Aug 26 03:26:42 devstack sudo[116549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:42 devstack sudo[116549]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78" returned: 0 in 0.345s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:42 devstack sudo[116554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4
Aug 26 03:26:42 devstack sudo[116554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:42 devstack sudo[116554]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4" returned: 0 in 0.326s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:42 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:42 devstack sudo[116559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4
Aug 26 03:26:42 devstack sudo[116559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:43 devstack sudo[116559]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78.f060b3f0-0c8f-424a-8acc-871721570fe4" returned: 0 in 0.247s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-f060b3f0-0c8f-424a-8acc-871721570fe4" released by "_delete_snapshot" :: held 1.377s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-c0379367-eb8d-44a4-92da-36befe227e78" released by "delete_snapshot" :: held 1.402s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Creating offline snapshot d71fbd5d-1008-4176-8136-7d0f18377fcd of volume b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e9fb31-ae2b-4006-b437-fc13a5830a07]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Created reservations ['9d024f31-2251-44c3-8b43-11a86252ad04', '4b7a4e74-163e-4fc6-8daf-ef54d0b843f5', '7be2301d-5242-43fc-a495-3608fd2a5d84', '539e0dbb-97ce-4dea-ae12-6500398619b4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:43 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Delete snapshot completed successfully.
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-3e52a788-1c99-42c7-9194-3a998c96ce8e tempest-ProjectMemberTests-1509217531 None] Lock "cinder-f060b3f0-0c8f-424a-8acc-871721570fe4-delete_snapshot" released by "delete_snapshot" :: held 1.571s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:43 devstack sudo[116562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb
Aug 26 03:26:43 devstack sudo[116562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:43 devstack sudo[116562]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb" returned: 0 in 0.353s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd 1G {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:43 devstack sudo[116567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd 1G
Aug 26 03:26:43 devstack sudo[116567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-c0379367-eb8d-44a4-92da-36befe227e78-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:43 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-c0379367-eb8d-44a4-92da-36befe227e78-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "cinder-quobyte-c0379367-eb8d-44a4-92da-36befe227e78" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-c0379367-eb8d-44a4-92da-36befe227e78" acquired by "delete_volume" :: waited 0.015s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:44 devstack sudo[116567]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd 1G" returned: 0 in 0.413s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33dd7de-f206-41d5-90ef-349124a73ceb -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90e31e9-f2e2-44fe-a2a8-07fabb6d57ca]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack sudo[116573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33dd7de-f206-41d5-90ef-349124a73ceb -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd
Aug 26 03:26:44 devstack sudo[116573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:44 devstack sudo[116574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78
Aug 26 03:26:44 devstack sudo[116574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:44 devstack sudo[116573]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b33dd7de-f206-41d5-90ef-349124a73ceb -F qcow2 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd" returned: 0 in 0.293s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:44 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd is being set with open permissions: ugo+rw
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack sudo[116580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd
Aug 26 03:26:44 devstack sudo[116580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:44 devstack sudo[116574]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78" returned: 0 in 0.374s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack sudo[116585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78
Aug 26 03:26:44 devstack sudo[116585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:44 devstack sudo[116580]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd" returned: 0 in 0.251s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack sudo[116588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info
Aug 26 03:26:44 devstack sudo[116588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:44 devstack sudo[116585]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-c0379367-eb8d-44a4-92da-36befe227e78" returned: 0 in 0.255s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-quobyte-c0379367-eb8d-44a4-92da-36befe227e78" released by "delete_volume" :: held 0.688s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Created reservations ['b512daf9-d0ea-4195-8f45-c6ede88e7a76', '57353170-c4c7-4fd3-bce3-95a9ec783dd6', 'bd268063-d191-4afe-a5d0-32fa763628f6', '106eb9e7-e983-4e41-ace9-e1a0b2a8040c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack sudo[116591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:44 devstack sudo[116591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:44 devstack sudo[116588]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info" returned: 0 in 0.264s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:44 devstack cinder-volume[94326]: WARNING cinder.volume.drivers.remotefs [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info is being set with open permissions: ugo+rw
Aug 26 03:26:44 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:44 devstack sudo[116594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info
Aug 26 03:26:44 devstack sudo[116594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:45 devstack sudo[116591]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.245s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Deleted volume successfully.
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-59959062-f26e-4f44-925b-e40616767cf3 tempest-ProjectMemberTests-1509217531 None] Lock "cinder-c0379367-eb8d-44a4-92da-36befe227e78-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:45 devstack sudo[116594]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.info" returned: 0 in 0.260s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:45 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-bb3b341e-8f04-438e-acb6-c416054cccc1 tempest-ProjectReaderTests-1670175729 None] Create snapshot completed successfully
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-d71fbd5d-1008-4176-8136-7d0f18377fcd-delete_snapshot" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-d71fbd5d-1008-4176-8136-7d0f18377fcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-b33dd7de-f206-41d5-90ef-349124a73ceb" by "delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-b33dd7de-f206-41d5-90ef-349124a73ceb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-d71fbd5d-1008-4176-8136-7d0f18377fcd" by "_delete_snapshot" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-d71fbd5d-1008-4176-8136-7d0f18377fcd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Deleting offline snapshot d71fbd5d-1008-4176-8136-7d0f18377fcd of volume b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] snapshot_file for this snap is: volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd {{(pid=94326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[26591537-3bab-43bc-ad15-1b7112ab5c5c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:45 devstack sudo[116599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd
Aug 26 03:26:45 devstack sudo[116599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:45 devstack sudo[116599]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd" returned: 0 in 0.386s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b33dd7de-f206-41d5-90ef-349124a73ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b31e6-bb65-4cec-ac10-7fe27e56e8c9]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:45 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:45 devstack sudo[116604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb
Aug 26 03:26:45 devstack sudo[116604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:46 devstack sudo[116604]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb" returned: 0 in 0.375s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:46 devstack sudo[116610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd
Aug 26 03:26:46 devstack sudo[116610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:46 devstack sudo[116610]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd" returned: 0 in 0.413s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:46 devstack sudo[116616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd
Aug 26 03:26:46 devstack sudo[116616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:46 devstack sudo[116616]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb.d71fbd5d-1008-4176-8136-7d0f18377fcd" returned: 0 in 0.259s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-d71fbd5d-1008-4176-8136-7d0f18377fcd" released by "_delete_snapshot" :: held 1.532s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:46 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-b33dd7de-f206-41d5-90ef-349124a73ceb" released by "delete_snapshot" :: held 1.570s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Created reservations ['4035207f-a3b7-46cb-aff9-a5bd62fe34e0', '2e37be94-2a79-419c-8814-42920f5af09c', '8f18a8b5-9f1b-4d5f-9cb7-fd190cdade00', '16d47e75-6584-442c-bf9c-09750dd691b4'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:47 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Delete snapshot completed successfully.
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-19966ad8-7b49-46d2-b0c5-55d28dea25e2 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-d71fbd5d-1008-4176-8136-7d0f18377fcd-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-b33dd7de-f206-41d5-90ef-349124a73ceb-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-b33dd7de-f206-41d5-90ef-349124a73ceb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "cinder-quobyte-b33dd7de-f206-41d5-90ef-349124a73ceb" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-b33dd7de-f206-41d5-90ef-349124a73ceb" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[801cfb58-1dc7-4a39-8e7f-b93200bd4dae]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:26:47 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:47 devstack sudo[116619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb
Aug 26 03:26:47 devstack sudo[116619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:48 devstack sudo[116619]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb" returned: 0 in 0.368s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:48 devstack sudo[116624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb
Aug 26 03:26:48 devstack sudo[116624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:48 devstack sudo[116624]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-b33dd7de-f206-41d5-90ef-349124a73ceb" returned: 0 in 0.288s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-quobyte-b33dd7de-f206-41d5-90ef-349124a73ceb" released by "delete_volume" :: held 0.734s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Created reservations ['9c4956dd-d84a-4629-a92b-76d702da1cf2', '4dcd82df-6266-47ec-b5c7-c720d0b0664b', 'e2739bfc-73f9-46a2-a713-67d9c5a483d3', 'a476eca1-59f4-4fd0-8507-f2494e5dabf8'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:26:48 devstack sudo[116661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:26:48 devstack sudo[116661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:26:48 devstack sudo[116661]: pam_unix(sudo:session): session closed for user root
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.264s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:26:48 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Deleted volume successfully.
Aug 26 03:26:48 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e4a80a68-6bab-4a5e-b6e9-822344265174 tempest-ProjectReaderTests-1670175729 None] Lock "cinder-b33dd7de-f206-41d5-90ef-349124a73ceb-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:02 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=41,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:27:02 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=25,cinder:UPDATE=43,cinder:INSERT=13,cinder:DELETE=2 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (9558c647-c7d0-495d-8ee5-9ea17f3ab0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a201499a-3956-486a-a15f-09d33efa76ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a201499a-3956-486a-a15f-09d33efa76ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732499723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e419f5-6b2f-4be4-8179-d90374b47379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:03Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b5e1db-ed2a-4071-87c2-9943be56a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b5e1db-ed2a-4071-87c2-9943be56a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9314216e-42f1-4412-a29f-dad81aceafdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9314216e-42f1-4412-a29f-dad81aceafdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e419f5-6b2f-4be4-8179-d90374b47379', 'volume_name': 'volume-96e419f5-6b2f-4be4-8179-d90374b47379', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eba3051-7553-419f-a2be-4eca8e77eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eba3051-7553-419f-a2be-4eca8e77eba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0422f0-a933-492b-8eb2-6214dd21c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:03 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Volume 96e419f5-6b2f-4be4-8179-d90374b47379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e419f5-6b2f-4be4-8179-d90374b47379', 'volume_size': 1}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-732499723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e419f5-6b2f-4be4-8179-d90374b47379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:03Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Creating volume 96e419f5-6b2f-4be4-8179-d90374b47379 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:27:03 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:03 devstack sudo[116676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379 1073741824
Aug 26 03:27:03 devstack sudo[116676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:03 devstack sudo[116676]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379 1073741824" returned: 0 in 0.408s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:03 devstack sudo[116682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379
Aug 26 03:27:03 devstack sudo[116682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:03 devstack sudo[116682]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379" returned: 0 in 0.249s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0422f0-a933-492b-8eb2-6214dd21c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e419f5-6b2f-4be4-8179-d90374b47379', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a09fbab-eea9-46af-8d0c-d2bebfe09dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:03 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Volume volume-96e419f5-6b2f-4be4-8179-d90374b47379 (96e419f5-6b2f-4be4-8179-d90374b47379): created successfully
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a09fbab-eea9-46af-8d0c-d2bebfe09dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:03 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (9558c647-c7d0-495d-8ee5-9ea17f3ab0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:03 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e92a44b8-0548-48d9-b47c-ae3f0165a03f tempest-ProjectReaderTests-93720178 None] Created volume successfully.
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-96e419f5-6b2f-4be4-8179-d90374b47379-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Lock "cinder-96e419f5-6b2f-4be4-8179-d90374b47379-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-quobyte-96e419f5-6b2f-4be4-8179-d90374b47379" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-96e419f5-6b2f-4be4-8179-d90374b47379" acquired by "delete_volume" :: waited 0.016s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a30c595-3995-434d-aef4-ace90b3092ac]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:04 devstack sudo[116685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379
Aug 26 03:27:04 devstack sudo[116685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:04 devstack sudo[116685]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379" returned: 0 in 0.355s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:04 devstack sudo[116690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379
Aug 26 03:27:04 devstack sudo[116690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:04 devstack sudo[116690]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-96e419f5-6b2f-4be4-8179-d90374b47379" returned: 0 in 0.231s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:04 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-96e419f5-6b2f-4be4-8179-d90374b47379" released by "delete_volume" :: held 0.623s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Created reservations ['ee2564e5-afcd-4e54-bf43-dffbe30d17a9', 'a087e7e3-19ef-4a41-a75d-f27ec1f0a6ae', '39b75283-2cb3-4321-8aa7-4511e6615c84', 'c2dcdb5d-b34b-4aec-ace5-5f0cf3e53ec5'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:05 devstack sudo[116693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:27:05 devstack sudo[116693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:05 devstack sudo[116693]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.232s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:27:05 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Deleted volume successfully.
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-e476aa82-c278-481f-a11e-f07a29f59c69 tempest-ProjectReaderTests-93720178 None] Lock "cinder-96e419f5-6b2f-4be4-8179-d90374b47379-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (0845c4a6-5036-4120-9ac9-335efbd87473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4c81f2-8aae-4840-a914-576e387c3f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4c81f2-8aae-4840-a914-576e387c3f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629039579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63216eb1-52d1-4447-895d-d1b347aa24e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:06Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7f93ef-91d6-4232-bcb3-76f4466bcc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7f93ef-91d6-4232-bcb3-76f4466bcc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19317f1c-729a-4b61-aade-992181d06663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19317f1c-729a-4b61-aade-992181d06663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63216eb1-52d1-4447-895d-d1b347aa24e7', 'volume_name': 'volume-63216eb1-52d1-4447-895d-d1b347aa24e7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d02ebd6-f355-4d22-81ba-f4e07ef068dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d02ebd6-f355-4d22-81ba-f4e07ef068dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e90b801-f6e8-4f77-95f6-5b7e6c0a9c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:05 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Volume 63216eb1-52d1-4447-895d-d1b347aa24e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63216eb1-52d1-4447-895d-d1b347aa24e7', 'volume_size': 1}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1629039579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63216eb1-52d1-4447-895d-d1b347aa24e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:06Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Creating volume 63216eb1-52d1-4447-895d-d1b347aa24e7 {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:27:05 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:27:05 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:05 devstack sudo[116696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7 1073741824
Aug 26 03:27:05 devstack sudo[116696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:06 devstack sudo[116696]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7 1073741824" returned: 0 in 0.394s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:06 devstack sudo[116701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7
Aug 26 03:27:06 devstack sudo[116701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:06 devstack sudo[116701]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7" returned: 0 in 0.240s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e90b801-f6e8-4f77-95f6-5b7e6c0a9c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63216eb1-52d1-4447-895d-d1b347aa24e7', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fc6f60-2e39-4129-9e58-dc9b63750404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:06 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Volume volume-63216eb1-52d1-4447-895d-d1b347aa24e7 (63216eb1-52d1-4447-895d-d1b347aa24e7): created successfully
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fc6f60-2e39-4129-9e58-dc9b63750404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (0845c4a6-5036-4120-9ac9-335efbd87473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:06 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-978ecfe6-775d-4823-bfd2-907d20b3eb29 tempest-ProjectReaderTests-93720178 None] Created volume successfully.
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-63216eb1-52d1-4447-895d-d1b347aa24e7-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Lock "cinder-63216eb1-52d1-4447-895d-d1b347aa24e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-quobyte-63216eb1-52d1-4447-895d-d1b347aa24e7" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-63216eb1-52d1-4447-895d-d1b347aa24e7" acquired by "delete_volume" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d3f2ad-58e3-4012-bc1a-127b74c316a0]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:27:06 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:07 devstack sudo[116704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7
Aug 26 03:27:07 devstack sudo[116704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:07 devstack sudo[116704]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7" returned: 0 in 0.363s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:07 devstack sudo[116709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7
Aug 26 03:27:07 devstack sudo[116709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:07 devstack sudo[116709]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-63216eb1-52d1-4447-895d-d1b347aa24e7" returned: 0 in 0.252s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-63216eb1-52d1-4447-895d-d1b347aa24e7" released by "delete_volume" :: held 0.651s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Created reservations ['f9ba047c-91aa-4c6e-b49c-3a122be79c72', 'b25a7571-b394-4e57-87e5-0331023a111d', 'e3ffebf4-067f-4892-b9b6-9e590bcef85f', '8ea3e50e-67ed-46d7-89c9-180103e431ee'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:07 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:07 devstack sudo[116713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:27:07 devstack sudo[116713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:08 devstack sudo[116713]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.260s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:27:08 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Deleted volume successfully.
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-38f8ddda-053b-4552-9761-ef1862143433 tempest-ProjectReaderTests-93720178 None] Lock "cinder-63216eb1-52d1-4447-895d-d1b347aa24e7-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (3d77edeb-16bd-4101-8c98-dd434655eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617bfa9d-fe64-4dfd-bf29-c9e646846236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617bfa9d-fe64-4dfd-bf29-c9e646846236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43838732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2da092-27db-4549-9489-f4efe61f1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:08Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d522b4-4d8f-4608-9cce-dfd6d30d6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d522b4-4d8f-4608-9cce-dfd6d30d6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c9d1a7-61e9-4620-abb5-f11028b3cc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c9d1a7-61e9-4620-abb5-f11028b3cc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2da092-27db-4549-9489-f4efe61f1fda', 'volume_name': 'volume-db2da092-27db-4549-9489-f4efe61f1fda', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c8919d-fc2d-4a89-830d-827f5b72c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c8919d-fc2d-4a89-830d-827f5b72c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6a2322-7bcd-4dc0-9125-fedf5bd6054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:08 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Volume db2da092-27db-4549-9489-f4efe61f1fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2da092-27db-4549-9489-f4efe61f1fda', 'volume_size': 1}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43838732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2da092-27db-4549-9489-f4efe61f1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:08Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Creating volume db2da092-27db-4549-9489-f4efe61f1fda {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:27:08 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:08 devstack sudo[116716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda 1073741824
Aug 26 03:27:08 devstack sudo[116716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:08 devstack sudo[116716]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:08 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda 1073741824" returned: 0 in 0.401s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:09 devstack sudo[116721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda
Aug 26 03:27:09 devstack sudo[116721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:09 devstack sudo[116721]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda" returned: 0 in 0.235s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6a2322-7bcd-4dc0-9125-fedf5bd6054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2da092-27db-4549-9489-f4efe61f1fda', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5b682b-63e8-41f9-b45b-9e5574d71872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:09 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Volume volume-db2da092-27db-4549-9489-f4efe61f1fda (db2da092-27db-4549-9489-f4efe61f1fda): created successfully
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5b682b-63e8-41f9-b45b-9e5574d71872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (3d77edeb-16bd-4101-8c98-dd434655eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:09 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-c34618af-5f8a-4671-9e6e-b4f0dac53864 tempest-ProjectReaderTests-93720178 None] Created volume successfully.
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-db2da092-27db-4549-9489-f4efe61f1fda-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Lock "cinder-db2da092-27db-4549-9489-f4efe61f1fda-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-quobyte-db2da092-27db-4549-9489-f4efe61f1fda" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-db2da092-27db-4549-9489-f4efe61f1fda" acquired by "delete_volume" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf99bc18-40b6-41a4-a737-e295d75971c5]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:09 devstack sudo[116725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda
Aug 26 03:27:09 devstack sudo[116725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:09 devstack sudo[116725]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda" returned: 0 in 0.344s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:09 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:10 devstack sudo[116730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda
Aug 26 03:27:10 devstack sudo[116730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:10 devstack sudo[116730]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-db2da092-27db-4549-9489-f4efe61f1fda" returned: 0 in 0.237s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-db2da092-27db-4549-9489-f4efe61f1fda" released by "delete_volume" :: held 0.616s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Created reservations ['b3092198-af44-4208-98cb-e6c69f76eb2f', 'c03d4ca6-6e6d-4a89-b7bb-94e1b5f718ee', 'f584c945-5a15-4dcb-9c1f-d06ad15b6b4d', 'f0819a5e-b8fd-4538-887c-cc34fb7e3e8c'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:10 devstack sudo[116733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:27:10 devstack sudo[116733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:10 devstack sudo[116733]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.239s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:27:10 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Deleted volume successfully.
Aug 26 03:27:10 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-4dd7f455-d880-4ba4-87be-8cd27f6cce63 tempest-ProjectReaderTests-93720178 None] Lock "cinder-db2da092-27db-4549-9489-f4efe61f1fda-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (d9f45e90-8b14-4536-a8f3-e38d36c03253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc02e766-1a42-4723-8ed4-293c025f1289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc02e766-1a42-4723-8ed4-293c025f1289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744674898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc9c274-9c0d-4e1b-921d-395fb7bff2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:11Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e543e4-bc56-406e-bdc4-6278b430c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e543e4-bc56-406e-bdc4-6278b430c867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba254bbe-0d76-4520-a186-406aa9432b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba254bbe-0d76-4520-a186-406aa9432b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc9c274-9c0d-4e1b-921d-395fb7bff2be', 'volume_name': 'volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80da86d0-668c-4777-b2f8-87be52a0616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80da86d0-668c-4777-b2f8-87be52a0616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d5daab-d830-49f0-af14-6a9d60927e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Volume 9cc9c274-9c0d-4e1b-921d-395fb7bff2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be', 'volume_size': 1}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7547fbaf5610>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-26T01:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744674898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc9c274-9c0d-4e1b-921d-395fb7bff2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28acb0446c7944909147a551953823b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:27:11Z,use_quota=True,user_id='1d69f103d22d4e44ae90e5bbd15c2ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d94551d-1e8f-420e-8c52-2e9f505a46b5),volume_type_id=4d94551d-1e8f-420e-8c52-2e9f505a46b5)}" {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.remotefs [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Creating volume 9cc9c274-9c0d-4e1b-921d-395fb7bff2be {{(pid=94326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Selected osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9 as target Quobyte volume. {{(pid=94326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Aug 26 03:27:11 devstack cinder-volume[94326]: INFO cinder.volume.drivers.remotefs [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] casted to osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be 1073741824 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:11 devstack sudo[116736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be 1073741824
Aug 26 03:27:11 devstack sudo[116736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:11 devstack sudo[116736]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be 1073741824" returned: 0 in 0.403s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:11 devstack sudo[116743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be
Aug 26 03:27:11 devstack sudo[116743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:11 devstack sudo[116743]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be" returned: 0 in 0.236s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'} {{(pid=94326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d5daab-d830-49f0-af14-6a9d60927e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be', 'volume_size': 1}' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9d4b88-9e37-4aa3-b9ec-dea035051622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 26 03:27:11 devstack cinder-volume[94326]: INFO cinder.volume.flows.manager.create_volume [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Volume volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be (9cc9c274-9c0d-4e1b-921d-395fb7bff2be): created successfully
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba9d4b88-9e37-4aa3-b9ec-dea035051622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 26 03:27:11 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Flow 'volume_create_manager' (d9f45e90-8b14-4536-a8f3-e38d36c03253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 26 03:27:11 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-3bb43ed8-dfb7-4b38-998b-f8bd6da0498c tempest-ProjectReaderTests-93720178 None] Created volume successfully.
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-9cc9c274-9c0d-4e1b-921d-395fb7bff2be-delete_volume" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Lock "cinder-9cc9c274-9c0d-4e1b-921d-395fb7bff2be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Acquiring lock "cinder-quobyte-9cc9c274-9c0d-4e1b-921d-395fb7bff2be" by "delete_volume" {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-9cc9c274-9c0d-4e1b-921d-395fb7bff2be" acquired by "delete_volume" :: waited 0.014s {{(pid=94326) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efaf8a2-4a26-4276-a76f-64ca28273f9c]: (4, 'qcow2') {{(pid=95315) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:12 devstack sudo[116746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be
Aug 26 03:27:12 devstack sudo[116746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:12 devstack sudo[116746]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be" returned: 0 in 0.343s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:12 devstack sudo[116751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be
Aug 26 03:27:12 devstack sudo[116751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-375dae91-7469-4857-9190-931d30634a66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:12 devstack sudo[116753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:27:12 devstack sudo[116753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:12 devstack sudo[116751]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313/volume-9cc9c274-9c0d-4e1b-921d-395fb7bff2be" returned: 0 in 0.247s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Lock "cinder-quobyte-9cc9c274-9c0d-4e1b-921d-395fb7bff2be" released by "delete_volume" :: held 0.628s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.quota [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Created reservations ['8a85a888-5563-41f9-90d4-46ba04677d75', '6b9eb510-6e5a-45d1-8de3-de3b09c489dc', '56a8b0f3-e34e-49a5-ba10-4858bdf9ec2d', 'bdcbac61-03b4-49e8-8499-473a09a177a6'] {{(pid=94326) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 26 03:27:12 devstack sudo[116753]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-375dae91-7469-4857-9190-931d30634a66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.258s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_service.periodic_task [None req-375dae91-7469-4857-9190-931d30634a66 None None] Running periodic task VolumeManager._thread_info {{(pid=94326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread count: 28 {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.volume.manager [None req-375dae91-7469-4857-9190-931d30634a66 None None] thread info: [<_MainThread(MainThread, started 128952137773184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128952024283968)>, <Thread(Thread-3 (stat_writer), started daemon 128952028547328)>, <Thread(Rabbit-heartbeat, started daemon 128952023265024)>, <Thread(Thread-5 (_runner), started daemon 128952023381888)>, <Thread(Thread-7 (_runner), started daemon 128952023598272)>, <Thread(fd_logger, started daemon 128952021321344)>, <Thread(privsep_reader, started daemon 128952019358784)>, <Thread(tpool_thread_0, started daemon 128952012998336)>, <Thread(tpool_thread_1, started daemon 128952004605632)>, <Thread(tpool_thread_2, started daemon 128951996196544)>, <Thread(tpool_thread_3, started daemon 128951987787456)>, <Thread(tpool_thread_4, started daemon 128951979378368)>, <Thread(tpool_thread_5, started daemon 128951970969280)>, <Thread(tpool_thread_6, started daemon 128951962560192)>, <Thread(tpool_thread_7, started daemon 128951954151104)>, <Thread(tpool_thread_8, started daemon 128951945742016)>, <Thread(tpool_thread_9, started daemon 128951937332928)>, <Thread(tpool_thread_10, started daemon 128951928923840)>, <Thread(tpool_thread_11, started daemon 128951920514752)>, <Thread(tpool_thread_12, started daemon 128951912105664)>, <Thread(tpool_thread_13, started daemon 128951903696576)>, <Thread(tpool_thread_14, started daemon 128951895287488)>, <Thread(tpool_thread_15, started daemon 128951886878400)>, <Thread(tpool_thread_16, started daemon 128951878469312)>, <Thread(tpool_thread_17, started daemon 128951870060224)>, <Thread(tpool_thread_18, started daemon 128951861651136)>, <Thread(tpool_thread_19, started daemon 128951853242048)>] {{(pid=94326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9': None} {{(pid=94326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG cinder.volume.drivers.quobyte [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d111424e-be49-40c0-8eab-cb3d9fa02bd9'] {{(pid=94326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.lockutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 26 03:27:12 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313 {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 26 03:27:12 devstack sudo[116757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313
Aug 26 03:27:12 devstack sudo[116757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 26 03:27:13 devstack sudo[116757]: pam_unix(sudo:session): session closed for user root
Aug 26 03:27:13 devstack cinder-volume[94326]: DEBUG oslo_concurrency.processutils [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ee92fd3517baddbc104a6c149ba2313" returned: 0 in 0.232s {{(pid=94326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 26 03:27:13 devstack cinder-volume[94326]: DEBUG cinder.manager [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Notifying Schedulers of capabilities ... {{(pid=94326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 26 03:27:13 devstack cinder-volume[94326]: INFO cinder.volume.manager [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Deleted volume successfully.
Aug 26 03:27:13 devstack cinder-volume[94326]: DEBUG cinder.coordination [None req-7ed3e102-d125-4abe-b237-11267830dcbe tempest-ProjectReaderTests-93720178 None] Lock "cinder-9cc9c274-9c0d-4e1b-921d-395fb7bff2be-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=94326) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 26 03:27:22 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=28,cinder:UPDATE=40,cinder:DELETE=5,cinder:INSERT=9 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 26 03:27:23 devstack cinder-volume[94326]: DEBUG dbcounter [-] [94326] Writing DB stats cinder:SELECT=28,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=94326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}